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Introduction 



As part of the evaluation of project Follow Through, the Institute for 
Development of Human Resources of the University of Florida (IDKR) assumed 
responsibility for collecting observational data in a sample of • classrooms 
representing a nU'mber of experimental programs. 'Hiree waves of data have been 
collected :^ 70 classrooms each in the winters of 1969 and 1970; and 289 in the 
winter of 1971. The results jfor the first two years are reported here. 
Two sets of goals lay bejiind this effortr 

1. To describe in behavioral terms the differences amqng the jixog-rams ^ 
as observed^in tlj,e classrooms-, and^ -'^^"^""''^'^'^ ^ 

2. To relate^Xhese^behavforal dimensions to pupil grqwth. 
As work advanced toward these goal's, several subgoals emjerged and will be 
described later. 1 

The observational measures were not focused directly on the identification 
of sponsor objectives and the development of items to represent them. Rather, 
they were selected from already existing instruments and represented a broad ^ 
con ption of q.lassroom interaction as it has been developed over the past years. 
The instruments ranged from one with very extensive research background to two 
with some previous use, to one which was newly developed from work of others. 

To enable study of relations between measures of classroom observation and 
pupil growth, Stanford Research Institute (SRI), the principal outside evaluator 
e of Follow Through procedure, provided test 'data on pupils. 

Procedure ^ 

' Sample 

Seyen programs were selected in which a% least eight classrooms could be 
observed which seemed. to represent the diversity of programs present in Follow. 
Tlirough (although the latter criterion was a subjective and uncertain one). 

ER?C il. 11 . 



Two comparison classrooms were selected from the same settings in which the 
programs were located, in the hope of equating, in a rougl\ way, system-related 
variance for program and comparison classrooms. Insofar aSvpossible, settings 

\ 

and programs were selected for observation where SRI was collecting complete data 
from pupils; 

OaQh yjear a total of 70 classrooms was obstsrved: eight program and_tWiCL- 

comparison classrooms from each of^sey.en. programsT'^The second year the attempt 

was^oiade , to t>b serve. the same teachers as far as possible. Exceptions to this 

were numerous, howevei^, (is a consequence of teacher resignations and promotions 

and, in one case, the need to replace an entire pommunity which had been sampj^ed . 

the first year, llie programs and the locations for the samples for the two years 

ai-e shown in Tables 1 and 2. Tlie way in whicn the sample was selected sets two 

limitations on the meaningfulpess of the results. One limitation is that SRI 

collected data in classrooms suggested by program sponsors as ones in which the 

program was being well implemented. This designation was made by sponsors at the 

beginning of the first year and on the basis of little information, and in some 

cases the ^election turned out later not to have been the best choice. The other 

\^ . ^ / 

limitation, a function both of sample and of schedule, wa^that the programs 

; \ 

had been in operation in some of these locations for only about three months at 
the time the first year's observation began. As a consequence, some classrooms 
'did not represent their programs well, and some programs had had relatively little 
time to become well implemented at the time of data collection. 

On the other hand, this situation was not as atypical as it may seem. 
Experience the second year indicated that it was not unusual for half of the 
teachers in a program to be replaced because of resignations and promotions. 
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Table 1 

*• Sample by Program and Coinmunity 



1969 ^ 



Conuaunity 



Atlanta, Ga, 

Berkeley, dalif , 

Burlingto/i, Vt, 

Cleveland^ Ohio' 
^/ouval Co. (vJax), Fla. 
' .Duluth, Minn. 

East St. Louis, 111 . 

Ft. Worth, Texas- 

Joriesboro, Ark. 

LaFayette,, Qa. 

Lau jril.; Delaware 

New York City 
^ Philadelphia, Pa. 

4k 

Racine, Wis. ^ 
Roche'iter, N. Y. 



Bank • 
Street 



Tuskegee, Ala. 



\ 



Vihcennes, Ind. 
^^ashingtdn, p. C. 

Program Total 
Comparison Total* 



Becker 
Engel- 
mann 



3+1 



.5+1 
2+1 



4+1 



8 

2^ ^ 



Educ . 
Devel . 
Center 



2+1 



4+1 



/ 



8 
2 



I 8 
2 



Gotkin 



4+2 



Nim- 
nicht 



3+1 



2+i 



Parent 
Educ. 



Tucson 



O The second entry- represents number of coipparison classrooms 

ERJC • . 



2+1 



3+1 
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-I 
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Tabic 2 



Sample by Program and Community - ,1970 



Community , 



Bank 
Str.eet 



Becker 
Gngel- 
mann- 



Educ. 

Devel. 

Center 



Gotkin 



Nirn^- 
nicht 



Parent 
Educ. 



/ 



Atlanta, Ga. 
Berkeley, Calif. 

Burlington,' , Vt/ 

/ 

DuvJri Co. (Jax/, Fla,, 

<Dul^th, Miifcfr 

East St. Louis, 111. 

'•Ft. Worth, Texas_ 

Jonesboro, Ark, . 

LaFayette, Ga, ^ 
\ 

Laurel, Delaware 

Lebanon, N. 

New York City 

Philadelphia, Pa. 

Racine^ Wis. 

Rochester, N. Y, ' 

Tuskegee, Ala. 

# Uvalde Texas 

Vinceijnes, Ind. 

Program Total 

^ "^ea^chi^fs observed 
both years 



2+1 
3+1 



8+2 



1+0 



4+2^ 



2+1 



3+1 



3+1 



4+1 



r 



8+2 



3+0 



8+2 



8+1 



8+2 



6+2 



3+ 
3+1 



2+1 



8+2 



I'+O 



2+1 



-3 - 



3+1 



8+2 



8+0 



■**TlK; second entry represents number of comparison classrooms. 
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Since many programs were approximately doubling each year at that point, three- 
quarters^ of the teachers in a program were new in many cases. 
Classroom Observation pleasures '-^ 

Florida Affective Categories (FLAG) and Florida Climate and Control 
System (FLACCS) - FLAC (Figure 1), which was used the first of the two years, 
was a modification of the^South Carolina Observation Records, which was developed 
to be used as a parallel observation schedule with Interaction Analysis (Soar, 
1966), The original instrument drew heavily on the Hostility-Affection Schedule 
(Fowler, 1962), and the earlier versions of the Observation Schedule and Record 
(Medley and Mitzel, 1958, private communication). The rationale of the ifistru- 
ment, overall, was the development of a schedule which would emphasize behavior 
which Interaction Analysis did not record. Among these were the nonverbal 
expression of affect in the classroom, physical movement of teacher and pupils, 
the groupings found in the classroom, and the extent to which individuals or 
groups were central in classroom activities. The nonverbal affect expression 
in the classroom seemed important to observe for two reasons: it seemed reason- 
able to assume that the teacher might be more successful in monitoring her verbal 
behavior than her nonverbal behavior when an observer was present (some evidence 
in earlier studies indicated this); and that relations between pupils might be 
antindicator of the emotional and social climate of the classroom which would be 
less likely to change with the presence of an observer than teacher behavior 

The Hostility-Affection Schedule allotted separate sections to the eight 
combinations of behavior: teacher-pupil, verbal -nonverbal ,^ and supportive-non- 
supportive. If, for example, the teacher raps on her desk for order, pushes a 
child .who is out of line, or waits impatiently for whispering to stop before 
proceeding, it would be tallied as teacher, nonverbal, nonsupportive. On the 

_ 15 
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Figure 1 - Florida Affective Categories (FLAG), 1969 

(Class Form) 



Teacher 
School 
Date ' 



^ Grade 
_ City \ 



Hour 



Observation 
Number 



Children's Original Art Work 



Abundance of 
varied and 
vivid art- 
work 



Quite a few 
varied and , 
vivid a.rt 
products 



Some chil- 
dren*.*; 
varied and. 
vivid art 
products 



A few'chil- 
dren's orig- 
inal varied 
and vivjLd 
art products 



No chil- 
dren * s 

original art 
produc ts 



Most are 
clearly re- 
lated to 
children* s 
subcultural 
bac ^E ^ouncl^ 



Room Displays\ a,nd Artifacts 

Quite a^few 
are rela^ted 

to children's children's 
subcultural subcullural 
background 



5me are 
related to 



bac kground 



A few are 
related to 
children's 
subcultural 
background 



No^e show any 
\reyia tionship 
bq' children's 
sjilicultural 
background 
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Figure 1 - Continued 



Tot 


1 


2 


3 


Teacher 










Leads singing, exercise, games 










Leaves, enters room 










pjovuo r I uuiy 










Withdraws from class 










Supervises pupil, closely 










Immobilizes pupils 










Pnshs. class YcTr ind. pupil 




















Ignores pupil- 










Refuses to attend pupil 










Attends pupil briefly 










Attends pupils in succession 










Attends pupil closely 










Attends simult. activities 










Meets pupil's nee.ds 










Direccs wich song or music 



Groupings 


Task 




Social 


Tot 


1 


2 


3 


1 


2 


3 


Tot 










2-3 P W/A 


















2-3 P W/o A 


















4-1/2 class W/A 


















4-1/2 class W/o A 


















1/2 class + W/A 


















1/2 class + W/o A 


















P. as.and. W/A 


















P. as" Itid. W/o A 


/// 






y/// 



Pupi 1 


1 


2 


3 


Tot 


Socks i n f ormat i on 










Gives information 










Poll ows cogn i ti vc 
jUan, T. pblm. 










Po LI oKs cogn i ti ve 
plaa, P. pblm. 










Absorbed in work 










Intcrmitt* nt work 




















Task-related movement 










Aimless wandering 










Leaves, enters room 










Withdrawn 
(ignores others) 










Shy, timid 
(watches others) 










Being near, following 










Seeks 'reassurance, 
support 




















Parallel nlay 










Work with 
socialization 










Collaborative work 
or play - 










Plays verbal game 










Talks to self 










Talks to others 










Adult work (P. init.) 










Adult work fT. init.) 










Corrects -others 










Pretends adult , 










Copies adult 










'*Mc too^'-copics .child 










Central-tel ling, 
showini^ 










Central group 




















'Middles with" 
materials 










Uses materials 










Ui^cs play object 
as itself 










Pretends play object 
is something else 
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Figure 1 - Continued 
Negative AFfcct 



Verbal 



Non-Vcrbal 



Tot 



Teacher 



Says ^*stop it" etc. 



Uses threatening tone 



Rejects child 



Blames 



Criticizes 



Waits for child 



l-rowiis 



Ignores child 



Points Pin|>er 



Makes threat 



4 



Sliakes finder 



Humiliates 



Yells 



Other 



Pushes or pulls 



Spanks 



Other 



Tot 



Tot 


1 


2^ 


3 


Pupil \ 


1 


2 


3 


Tot 










Savs "no'* etc. 


^^al OS face /. 


















Teases 


Frov.'ns , pouts , withdraws' 














\ 




Laughs 


Uncooperative, resistant 


















Tattles • 


Interferes 


















Commands or demands 


Threatens 


















Makes disparaging remark 


Takes prop, of another 


















Makes someone "feel small" 


Damages prpp. of others 


















Finds fault 


Picks at child 


















Threatens 


Pu..*^hes of nulls 


















Blames 


1 folds 


















Cries 


Hits 


















Starts fight 


Hurts someone with 
son>ething 


















Other 










Other 











Positive Affect 



Tot 


1 


2 


3 


VS^Al^l** 1 ^ 

Teacher 


1 


2 


3 


Tot 










Says "thank you" etc. 


Accepts favors for self 


















Agrees with child 


»Vaits for cliild 
















Gives individual attention 


Cives individual attention 


















Accepts favors 


Synipatheti c 


















Sympafhetic 


Listens carefully to child 


















Praises child 


.Smi les , laughs 


















Draws aM into group 


Pats, fondles, hugs child 
















Other 


Other 










Tot 




2 


3 


v^nrhnl V. Non-Verbal • 
Pupi 1 ^ 


1 


2 


5 


Tot 










Says "thank you" etc. 


Pats, fondles, hugs toy 
or do 1 1 


















Asks nermission in 
friendly manner 


Helpful , shares 


















Agrees wi th another 


Leans close to another 


















Chooses another ' 


Chooses another , 


















Offers to compromise, 
share, cooperate 


Smiles, laughs with ' 
another 


















Defends another 


Does something for someone 


















Enthusiastic, happy 


Sympathetic 


















Praises another 


Pats, fondles, hugs another 


















Other 


Agreoab 1 e , cooperative 




















Hnthusiastic, happy 










>i : 


Other 
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Figure 1 - Continued 





\ 


Pupil Interest-Attention 


Ra tine ^ca 1 e 






. Interes^ 
general 
and high 


Most pupils 
interested 
much of time 


About half 
interested* 
much of time 


Occasional 

pupils 

interested 


Pupils gen. 
apathetic , 
uninterested 


Obser- 


• 






V- 




vation 












1 


5 


A 


3 


2 


L 


2 


5 


A 


3 


2 




3 


5 


A 


3 


2 * 


\ 1- 



Higftly 
Positive 



/ 



Overall Eraotional-Attiuudinal Climate ' 



Positive 
most of 
the time 



Neither 
Positive nor 
Negative 



Negative 
Occasion- 
ally 



Highly 
Negative 



Children 
appear 
extremely 
happy and/ 
or satis- 
fied 



Most pupils 
appear happy 
and/or sat- 
isfied much 
of time 



About half 
appear happy 
and/or sat- 
isfied much 
of time 



Occasnlly 
pupils ap- 
pear happy 
and/or sat- 
is fied 



Children 
appear ex- 
tremely un- 
happy and/ 
or dissatis- 
fied 



\ 
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Grade 
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Figure 2 - Classroom Global Ratings, 1969 

School 

^ City 

Date 



Observer 



Fixed and regular Mostly 
for activities fixed 



Pupil Groupings 

Emerge about 
half the time, 
Fixed half 
the time 



More often 
emerge spon- 
taneously 



Usually emerge 
spontaneously 



. _ Pupil Differentiation 

Most work at 

Almost always Most work at same activity Wbrk at different Usually work 

work at same activity half of the activities more at different 

activity most of the time time often- than not activities 



Words clearly 
contradict 

^evident 

\^eelings 



Teacher Congruence 

No feelings 
expressed; 
'^Accepts § 
Clarifies" 



Completely 
open expres- 
sion of 
feelings 



Unaware of 

conspicuous 

feeling 



Occasionally 
aware of 
obvious 
feeling 



Teacher Empathy 



Usually aware 
of obvious 
feeling 



Sometimes 
aware of 
subtle 
feeling 



Often aware 
of subtle 
feeling 
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Edgure 2 - Continued 



' From other pupils: Never 

1 



From adults: 



Pupil Reinforcement 

Almost 

Rarely Occasionally Frequently Constantly 
2 3 4 5 



From materials: 



Almost 

Constantly Frequently Occasionally Rarely 
5/4 3 2 



Never 



Never 



1 



Almost 

Rarely Occasionally Frequently Constantly" 



Rarely free 



Pupil Self-Control 

Show 
occasional 
self-control 



Generally free § 
self-controlling 



Show little 
self-control 
1 



Extent to which activities having clear cognitive focus characterize the classroom 

Rarely About 1/4 of About 1/2 of About 3/4 of Occur Almost 
occur the time the time the' time constantly 

12- 3 V '4 5 



Extept to which "game-like'' activities with clear cognitive focus characterize 
the classroom: 

Almost About 3/4 of About 1/2 of About 1/4 of Rarely 

constantly the time the time the time occur 

5 4 3 2 . 1 
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Figure 2 A - Classroom Global Ratings, 1970 



Fixed § regular Mostly 
for activities fixed 



Pupil Groupings 

Emerge about half 
the time; fixed 
half the time 



More often emerge 
spontaneously 



Usually emerge 
spontaneously 



A 



Almost always 
work at same 
activity 

1 



Pupil Diffexentiati'on^ 



Most work at 
same activity 
most of the 
time 



Most work at 

same acti-vity Work at different Usually work 

half of the activities more at different 

time often than not activities 



No feelings 
expressed 

0 



Teacher Congruence 



Words clearly 
contradict evi- 
dent feelings 



Some agreement 
of words and 
feelings ■ 



Words and 
feelings 
clearly agree 



Occasionally 
-Unaware of aware of 
conspicuous obvious 
feeling feeling 



1 



Teacher Empathy 



Sometimes 

Visually aware of aware of 
obvious feeling 



Often aware 
:,f subtle 
subtle feeling feeling 



Pupil Reinforcement 

From other pupils: Never Rarely Occasionally Frequently Almost constantly 

1 '2 3 4 .5 



From adults: Almost constantly Frequently Occasionally Rarely Never 

; . 5 4 3 2 1 

From materials: Never Rarely Occasionally Frequently Almost .constantly 

1 2 3 4- . ■ S 
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Figure 2 A - Continued 



Pupil Self -Control 



Pupils: Rarely show . Occasionally show Generally show 

self-control self-control * . self-control 



Pupil Freedom 



Pupils are: Rarely free Occasionally free Generally free 

' ' 12 3 4 5 

Extent to which activities having clear cognitive focus characterize the classroom: 

About 1/4 About 1/2 About 3/4 Occur almost . 
Rarely occur of the time of the time of the time constantly 



1 



Extent to which "gaiii;e'^-like'' activities with clear cognitive focus characterize the 
classroom: ' ^ 

"\ About 3/4- About 1/2 About 1/4 

Almost constantly of the time of the time of the. time Rarely occur 

5 4 3^2 1 



Overall Emotional^Attitudinal Climate 



Positive most! Neither positive Negative Highly 
Highly positive of the time nor negative occasionally negative 



Children appear 
extremely happy 
and/or satisfied 



Most pupils 
appear happy 
and/or satis- 
fied much of 
time 



About half 
appear happy 
and/or satis- 
fied much of 
time 



Occasionally 
pupils appear 
happy and/or 
satisfied 



Children appear 
extremely unhappy 
and/or dis- 
satisfied 
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Overall, the number of items was increased, and the question of dividing 
the instrument in two was considered. This alternative was rejected, however, 
since much of the affect expressed by adults is used in classroom management, 
and some portion of pupil affect is interactive with adult control . The instru- 
ment is shown in Figure -3. 

Teacher Practices Observation Record - The Teacher Practices Observation 
Record (TPOR) is an instrument developed to measure a teacher's practices in 
relation to John Dewey's Experimentalism (Brown, 1968). It consists of 62 sign 
items of teacher behavior (see Figure 4). There are no pedagogically ''bad*' items 
on the TPOR; every item describes a teacher .behavior that is widely practiced in 
schools. However, half the items (the even nu^jbers) describe behavior which re- 
flects agreement with Experimentalism and would be espoused by John Dewey; the 
other half (the odd numbers) reflect disagreement. In the original procedure, 
the observer's task was to check those items .which occurred during three ten- 
minute observation periods. The time periods used in this project have been 
limited to five minutes in order to parallel FLAG and FLACCS. 

Brown has done extensive researc/h with the instrument, relating it to 
measures of beliefs, and has shpwn re/ations between a teacher's beliefs and 
teaching practices, and between an o^^)server's beliefs and what he sees in the 
classroom. ~ ^ j 

The TPOR provides information whicli relates to the instructional or 
pedagogical practices employed in the classroom. The major classifications of 
items for recording behavior are (a) Nature of the Situation, (b) Nature of the 
Problem, (c) Development of Ideas, (d) Use of Subject Matter, (e) Evaluation of 
Pupil's Work, (f) Differentiation of Tasks, and (g) Motivation and Control. 
Data are produced describing whether the teacher or pupil is the center of 
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Figure 3 



Florida Climate and Control System (FLACCS), 1970 



Institute for the Development of Human Resources 
College of Education 
University of Florida 
Gainesville, Florida 



Program: Teacher.: 

{ 

City: Grade: 



School: I Date: 

\ 

' Team: 



•k 

This is an experimental instrument developed by Robert S. and Ruth M. Soar, and 
Marjorie Ragosta, and should not be cited or used without permission. 
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Figure 3 


■ Continued 












roT ' 


1 


2 


3 


Tvacher ^ 


roT 


1 


J- 


5" 


Pupil 






10 










Teacher central 


10 










Fupil Central ' , 






11 










Leads singinfc, Rames, -story 


11 










Pupil — no choice * 






12 










Moves freely amonK pupils 


12 










Pupil — limited, choice 






. 13 










Leaves, enters room 


13 










Pupil — free choice 






14 










Withdraws from class 


14 










(♦S^t work without teacher 






15 










Uses blackbd,", A-V equip« 


15 










(♦Seat work with teacher 






16 










Ignores pupil 


16 










Leaves, enters room 






17 










Attends pupil briefly 


17 










Task-related novement 






18 










Attends;.pupil closely 


It 










Aimless wandering , 






19 , 






i_ 




Attends^ simult. activities 








V 


















1 


2 


3 




* . ♦ 




20 




1 


2 


3 


Verbal: 


19 










Speaks aloud w/o .permission 




4 








'jCalls child by name 


20 










Knf^Qges in out-of-bound bel^ 






21 










Directs, without reason 


21 










Collaborates with teacher 






22 










Directs, with res*3n 


22 










C'^JDisobeys directions 






23 










Questions for control 


23 










(♦Passive resistance 






24 










Calls on nonvolunteer 


24 










(♦Obeys directions 






25 










Interrupts pupil, cuts off 


25 










Asks permission 






26 










Uses time pressure 


26 










Follows routine w/o reminder 






27 










Bribes 


27 










Reports rule to another 






28 










Threatens, scolds w/conseq« 


28 










Gives direction' 






29 










Gives orders, coimnands 


29 










Gives reason 






30 










Suggests ^ 


30 










Sasses teacher 






31 










Uses sharp tone 


31 










Tattles 






32 










Supervises pupil closely 














.33 










Nags 














34 










Immobilizes pupil , 






1 


2 


3 








35 










Uses sarcasm 


32 










(♦Works, plays w/much supv. 






36 










Scolds, punishes 


33 










(♦Works, plays w/li?tlo supvT 














34 










Works, plays cooply. , collab. 


/ 












35 










Works, plays competi.t« 




- 


37 




I 


2 


3 




36 










Seeks reassurance, support 














Uses Self report 


37 










Shows pride 






38 










Questions, states beh* rule 


38 










Shows- shame, fear, humil. 


* 




39 










Questions for reflect, thgt. 


39 










Shows apathy 






40 










Discusses behavior with P« 














41 










Uses humor 


j 








* 




42 










Praises 


/ 




1 


2 


3 


Work Groups 














40 










Pupil.as individual 














41 










Group with teacher 






43 




1 


2 


3 


Nonverbal: 


' 42V 
4l>- 










Structured groups 














Nods, smiles, for control 










Free groups 




44 










Tolerates deviant behavior 














45 










Unable to deal w/devt. beh. 














46 










Gesture, shhh, shakes head 






1 


2 


3 


Socialization 


^ ^ 




47" 










Siftnals, raps, etc. 


44 










Almost never 


\ 




48 










Tokes/cives equipment; book 


45 










Occasionally, verbal 




) 


49 










Glares; frowns 


46 










Frequently, verbal 




50 










Physical intervention: 


47 










Occasionally. .nonverbal 














Touches, pnts 


48 










Frequently, nonverbal 






51 










Holds, pushes 














52 










Punishes (other) 












* 


53 










Isolates 






1 


2 


3 


Materials 












49 










Structure teacher behavior | 












50 










Structure pupil behavior | 










51-52 










Pupil interest-attention | 
(Rank 1 low to 5 high) 
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Figure 3 - Continued 



VERBAL AFFECT 



NONVERBAL AFFECT 



1 




i 


*> 




~ — ^ ■ ' ' 

1 Gscner ne^u c i v« 




OT 


1 


2 


3 » 


Teachen Negative 


10 










csys Stop 1 *» t ^tu» * 


10 










Waits for chi-ld _ ^} 


li 










uscs^ tnrea ceil JLiH5 i^wut; 


11 










Frowns 


12 










Rejdipts child '* 


12 










Ignores child 


13 










Blaf^es 


13 










Points, c>shakes finger ^ 


14 










Criticizes j 


14 










Pii<;hps or nulls holds 


15 










m0kc:i threat X 


15 










Spanks 


16 










Humiliates 


16 










Shows disgust , 


17 


/ 


\ 






Yells 


17 










Other 


18 










.Uses sarcasm 










) 


19 










Other* • 
































A 


1 


2 , 


3 


\ 

9- 
% 

Pupil Negative 






1 


2 


3 


Punil Necative * • 


20. 










Says no , etc. 


18 










Makes face 

Frowns , pou ts , wi thdraws 


21 
22 










Teases . 
Laughs 


20 










Uncooperative, resistant . , ^ 


23. 










Ta-ttles 


21 










Tntorferes 


24 










Commands or demands 


22 










Threatens 


25 
26 
27 




1 






Makes disparajtinf: romlcs» 
Makes someone"feel smnllC 


23 










Takes, damages property 
of others 










Finds fault 


24 










PirWs at child » 


28 










Threatens 


25 










Pushes or pulls, holds 


29 










Blames 


26 










Hits f 


30 










Cries 


27 










Hiirt^vwith something 


31 










Starts fight 


.28 












32 










Other 


29 










Other 




1 


2 


3 


1 Teacher Positive 






1 


2 


3 


Teacher Positive 


33 




1 — r- 




Says JJhank you , etc.- 


30 










Accepts favors for self 


34 










v^'greeV with chiild 


31 










Waits for child , 


35 










-^Gives ihdividual attent. 


32 










Gives- individual Attention 


36 
37 










Accepts favors 


33 










Sympathetic, warm 










Sympathetic, warm 


34 










Listens carefully to child 


38 










'Praises child 


35 










Smiles, laughs, nods 


39 










Draws all into group 


36 








Touches, pats, hugs chllci 


40 










Is 'enthusiastic, congenia] 


I 37 






1 


Other 




1 


2 


3 










2 


'3 


Pupil positive 


41 
42 










Says "thank you", etc. 


38 










Helpful,* shares 










Sounds friendly 


39 










Leans close to another 


-43 
44 
45 










Agrees with another 


40 










Chooses anot)ier 










Chooses another 


41 










Smiles, laughs with another 










Offers to share, coop. 


42 










Sympathetic 


' 46 










Defends another 


43 










Pats, hugs another 


47 










Is enthusia'stic, happy 


44 










Agreeable, cooperative 


48 










Praises another 


45 










Enthusiastic, happy. 


49 










Helps another 


l46 










Horseplay 
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Ratings 




Pupil Groupings 




Pupil Differentiation 






Teacher Congruence 






Teacher Empathy 






Reinfor. .from Pupils , 






Reinfof. frc»i Adults 






Reinfor. from Materials 






Pupil Self-Control 






Pupil Freedom 






Cognitive Focus 






t 

Game-Like Activities 






Posit ive-Neg. Climate 






Pupils Happy, Satis. 





\ 
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Figure 4 - Teacher Practices Observation Record* 















TEACHER PRACTICES 


TOT 


1 


1 1 


1 1 1 






A. NATURE OF THE SITUATION 












T 


occupies center of attention. 










2. 


T 


makes p center of attention. ^ 










3- 


T 


makes some Ihlna- as a thing center of d's attention. 












T, makes doing. some thinq center of p's attention. 










5. 


T 


has p spend time waiting, watchinq. listening. 










6. 


T 


has p participate actively. 










7. 


T 


remains atoof or detached from d's activities. 










8. 


T 


ioins or participates in p*s activities'. 










?. 


T 


discourages or prevents p frbni expressing self freely. 










10. 


T 


encourages p to express self freely. 


1 








B. NATURE OF THE PROBLEM 










11. 


T 


organizes learning around Q posed by T, 










12. 


T 


organizes learning around p*s own problem or Q. 










»?. 


T 


prevents situation which causes p doubt or perplexity. 










1^4. 


T 


involves p in uncertain or incomplete situation. 










15. 


T 


steers p away from ''hard" Q or j3roblem. 










16. 


T 


leads p to Q or problem which "stumps" him. 










17. 


T 

of 


emphasizes idealized, reassuring, *.or "pretty*' aspects 
topic. 










18. 


T emphasizes realistic, disconcerting, or'"ugly" aspects 
of topic. 










19. 


T asks Q that p can answer only if he studied the 
lesson. 










20. 


T asks Q that is not readily answerable by study, of 
les^n. 






— 




C. DEVELOPMENT OF IDEAS 










21. 


T 


accepts only one answer as being correct.. 










22. 


T permits p to suggest additional or alternative * 
answers . 








T 


23. 


T 


expects p to come up with answer T has in mind. 








\ 

4 


2^4. 


T asks p to judge comparative value of answers or 
suqqes t i ons . 










25^: 


T 


expects p to "know" rather than to guess answer to Q. 










26. 


T encourages p to guess or hypothesize about the 
unknown or untested. 










27. 


T accepts only answers or suggestions closely related 
to topic. 










28. 


T 


entertains even "wild" or far-fetched suggestion of p. 










29. 


T lets p "get by" with opinionated or stereotyped 
answer. 










30. 


T 


asks p to support answer or opinlcfii with evidence. 
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Figure 4 - Continued 



TOT 


1 


n 


It) 


0. USE OF SUBJECT HATTER 










3K T collects and analyzes subiect matter for d. 






Hi 




32. Thas p make his own collection and analysis of 

subiect matter. 










33. T provides- o-^wlth detailed facts and information. 










3i*. T has p find detailed facts and information on his 

own. [ . 










35 T relies heavily on textbook as source of information. 










36* T makes a wide ranqe of information material available. 










37. T accepts and uses inaccurate information. 










38. T helps p discover and correct factual errors and 
inaccuracies. 










39. T permits formation of misconceptions and over- 
qeneral Izat ions . 










ijO. T questions misconceptions, faulty logic, unwarranted 
conclusions* 










• 

E. EVALUATION 










i4l. T passes judqmcnt on p's behavior or work. 










^42. T withholds iudqmcnt on p<s^ behavior or work. 










T stops p from going ahead with plan which T knows 
will fai>L 










M+. T encouraqes p to put his ideas to a test. 










^5. T intTwdiately reinforces p»£ answer as "right*' or 

"wronq." ^ 










^46. T has D decide when ,0 has been answered satisfactorily. 










47. T asks another p to give answer if on*' p fails to 

answer quickly. •/ — 










^8 T asks p to evaluate his own work. 










^9* T provides answer to p who seems confused or puzzled. 










50. T qives p time to sit and think, mull thinqs over. 


• 








F. DIFFERENTIATION 










51. T has all P workinq a t^ same task at same time. 










52. T has different p worki'nq at different tasks. 










53. T holds all p responsible for certain material to be 

learned. . 










5^4. T has p work independently on what concerns p. 










55. T evaluates work of all p by a set standard. 










56. T evaluates work of ditrerent p oy airrereni 
standards. 










G. MOTIVATION. CONTROL 










57. T motivates P with privileqes, prizes, qrades. 










58. T motivates p with intrinsic value of ideas or 
activity. 










59. T approaches subject matter in direct, business-like 
way. — 










66. T approaches subiect matter in indirect, informal way. 










61. T imposes external disciplinary control on p. 










62. T encouraqes self-discipline on Part of p. 



*Developed by Dr. Bob Burton Brown, Institute for Development of 
Human Resources, College of Education, University of Florida, 
Gainesville, Florida. 
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attention, the extent to which pupils are active or passive, and the amount of 
^.freedom which is permitted pupils. The nature of the problem is organized 
around the concerns of pupils or the concerns of the teacher or texty"ook, as 



ideas are treated in a ^'hypothetical" or "expository'* manner, and whether they 
are dealt with in a creative or routine fashion. Subject matter is classified 
as to whether the pupils or the teacher assumes primary responsibility for 
locating it, whether it is taken from a textbook or a wide range of sources, 
whether it is accurate or inaccurate* Whether the teacher evaluates the pupils* 
work or the rupils engage in self-evaluation is recorded. The degree to which 
the classroom tasks are differentiated for individual pupils is measured, along 

with the extrinsic-intrinsic nature of the motivation and the type of the dis- 

* /J 

ciplinary control." 

V 

Florida Taxonomy of Cognitive Behavior - The original instrument was 



developed by the Florida group under Brown's leadership. Its history originates 
with The Taxonomy of Educational Objectives: The Cognitive Domain (Bloom and 
others, 1956), which was modified and extended by Sanders (1966) '^to provide an 
instrument to assess teacher lesson plans and teaching materials. The work of 
the Florida group has consisted of converting Sanders/ instrument to one for 
live observation in the classroom, and of carrying out developmental work with 
it in classrooms. The levels into which cognitive activity is divided are as 
follows: 

1. Memory. The student is expected to recognize or remember informa- 
tion. Jle is not expected to compare, relate, or alter the material 
on his own. 




well as the difficulty of study topics. Information is yj.elded as to whether 



X 
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2. Translation . At this level, the student is expected to alter the 
form of the material with which he is dealing figurative to 
literal, behavioral to verbal, verbal to quantitative, pictorial to 
verbal, or abstract to concrete -- but not to chan^or evaluate the 
ideas represented. 

3. Interpretation . The student is expected to identify similarities or 
differences, to compare on some other basis, to relate supporting 
evidence to a generalization, or to carry out a specified operation. 

4. Application . The student is expected to bring together, without 
instruction,, previously learned mat.erial which relates to a problem. 

0 

Examples would include using word-attack skills to sound out a word, 
or deciding what mathematical operation is appropriate to solve a 
problem and carrying it through. 

5. Analysis . This category is concerned with consciously applying the 
l^^ules-'of thinking or of logic to the analysis of a problem, with 
inferring feelings or motives. 

6. Synthesis . This level involves bringing ideas together, as in appli- 
cation, but with the added requirement that the student reorganizes 
or changes them in such a way as to produce something new. Original 
productions of various sorts would be classified here. 

7. Evaluation . This level requires two functions: establishing a set of 
criteria, which are relevant to evaluate an idea or a prodiict, and then 
evaluating the product or idea against these criteria. 

In the development of the original instrument, data were collected from 
approximately 120 teachers using this system in parallel with the Reciprocal 

-.32 



Category System and the Teacher Practices Observation Record. Analysis has 
indicated meaningful relationships with the other instruments (Wood, 1969: 
Bane, 1969). 

Although the initial research plan anticipated using the original form of 
the instrument, .it was found difficult to apply to kindergarten-first grade class- 
rooms, and a new version of the instrument was developed. The modification was 
developed in two ^stages. First, observers who had visited classrooms in the first 
year data collection developed items to represent the levels of the Taxonomy from 
their memory of the classrooms. Tften these items were tried out in tape listen- 
ing, new ones developed as needed, and old ones modified or redefined. When the 
items stabilized, the form of the instrument was fixed and tape coding was begun 
(see Figure 5). * 

^he usual recording procedure used with a sign system was modified as well. 
(Jirdinarily an item is tallied only once in an observation period, but it seemed 
possible that tHe high rate of pupil response which is emphasized in some programs 
might be seriously under-represented. As a consequence, the procedure of tallying 
every three seconds (or each interaction) was followed. Since conventional sign 
data typically discriminate effectively (and, in fact, were found to do so for 
FLAG and the TPOR in these data), the data of the Cognitive Taxonomy were also 
analyzed with each observation period scored zero or one (for any nonzero fre- 
quency, regardless of size). Since the latter data appeared to be at least as 
disdriminating, only those are reported, and zero or one recording was employed 
with" the second yearns data. 

A superficial consideration of the cognitive domain sometimes suggests 
that its higher levels are more appropriate for older .pupils than younger. Yet 
* ^ 
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Figure 5 - Florida^Taxonomy of Cognitive Behavior, 1969-70* 
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1 . Memory 


/ 


/ 




1 a. 


Repeats from memory- 


'/ 


/ 


/ 


b. 


Repeats other 


/ 


/ 


■/ 






> 

/ 


■ / 


/ 


'c. 


Repeats in sequence 




/ 


/ 










/ 


d. 


Choral response 


/ 


/ 


/ 




t 


/ 


/ 


y 


e . 


Spells 


/ 


/ 


/ 


f . 


Gives, receives information 


1 


/ 


/ 






1 


1 


/ 


g- 


Seeks information 


1 


1 


/ 










2. Translation - ' 


J 

1 


1 


/ 


a.. 


Sounds letters 


1 

1 


1 


/ 


b. 


Names pictures, objects, color. 


/ 


1 


/ 




letter 


1 


1 


- / 


c . 


Copies letter, number, word 


1 


1 


/ 




(learned) 


1 


/ 


/ 


d. 


Gives, follows directions 


I- 


/ 


/ 






1 


/ 


/ 


e. 


Describes activity, picture, etc. 


1 


/ 


/ 






1 


/■ 


/ 


f . 


Reports experience (2+ thougths) 


1 


/ 


/ - ■ 


g- 


Describes situation, event 


i 


/ 


/ 






■ 1 


/ 


/ 


h. 


Recognizes word (sight reads) 


1 


/ 


/ 


1 . 


Translates one language to anothe 


1 


/ 


/ 


j • 


Asks, gives permission 


3. Interpretation 


/ 


/ 


/ 


a. 


Sound St out word 


/ 


/ 


/ ■ 


b. 


Classifies (1 attribute) 


/ 


/ 


/ 


c. 


Counts 


/ 


/ 


> / 


d. 


Adds, subtracts 


/ 


/ 


/ 


e . 


Uses units, tens 


. / 


/ 


/ 


f. 


Compares letters, numbers 


/ 


• / 


/ 


g- 


Copies letter (s), number(s). 


/ 


/ 


/ 




learning 


/ 


^ / 


/ 


h. 


Gives class name (vehicle , etc.) 


/ 


/ 


/ 


1 . 


Identifies similarities, differ- 


/ 


/ 


/. 


ences 


/ 


/ 


/ 


3- 


Asks, gives reason 


/ 


/ 


/ 


k. 


Names sensation 


/ 


/ 


r 


1. 


Performs learned task or process 


/ 


/ 


1 


m. 


Relates terms (of one-first) 


/ 


/ 


1 


n. 


Makes comparisons 



\ 
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' Figure 5 - Continued 
Activity ^_ Teacher Program 



" T / P 


T . / D 


T 


r 1^ 


! 


Application 


/ 


/- 


1 




a. 


Classification , (2+ attributes) 


■ . / 


/ ^ 


1 




b. 


Directs learning game 


/ 


1 


1 




c. 


Creates arithmetic problem 


/ 


1 . 


1 




dv 


Writes, types sentence 


/ 


/ 


■ 1 




e. 


Asks, tells who, what, where, etc 


1 


1 


1 




f. 


Seriates (alphabetizes) 


A 


1 


1 




g- 


Applies previous learning to new 
situations 


/ 


1 


1 




h. 


Reads 










5. 


Analysis 


/ 


1 


1 




a. 


Verifies equation balance 


/ 


1 


, / ■ 




b. 


Infers feeling or motive 


1 


1 


■ / 




c. 


Infers causality (tells why)' 


1 


• / 


1 




d. 


Cites evidence for conclusion 


\ 








6. 


Synthesis 


!/ 


/ 


1 




a. 


Elaborates on picture, story, etc 


• i / 


/ 


1 




b. 


Proposes plan or rule 


7 


/ 


1 




c. 


Play acts 


. / 


1 


1 . 




d. 


Makes up story 


1 


1 


1 ' 




e. 


Makes fantasied object 


1 


■ / 


1 




f. 


Makes common object 


1 


1 


1 




?• 


Draws, colors common object 


1 


1 


1 




h. 


Draws, colors fantasied' object 










7. 


Evaluation 


1 ■ 


1 


r 




a. 


Compares with criteria,,, rule or 
plan 



This is an experimental form which should not be cited or used without permission 
of the developers. 
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attention to the cognitive activities of classrooms showed that activities, 
at least through the middle levels of the instrument, occurred fairly frequently. 
The difference, of course, is that simpler materials and concepts are involved. 
The development of a Piagetian concept such as conservation falls at the level 
of synthesis,^ and the discussion that accompanies a^ story or a reading lesson 
may deal with questions such as, "What else might, Jimmy have done?" (synthesis). 



or "Would it have been better if Jimmy had done 'something different? Why?" 
(evaluation) , 

The complexity of the concepts and the r^ature of the subject matter will 
differ from age to age, of course, but higher devel thought processes seem 
clearly to be an important part of the development of the young child. 

Jn fact, an idea that became more compelling as the instrument was 
developed was that much of the learning dope by pupils in the lower grades is 
learning how to do processes that occur with little thought for older pupils. 
For example, the item "Reads" is at the lowest cognitive level in the general 
purpose instrument, but is a high level item for pupils at the kindergarten, 
first grade level. Deriving the multiplication table is a demanding operation, 
but as a tool in use it is low level, and becomes most useful when it reaches 
the level of memory. Indeed, a realization that emerged which seems paradoxical 
in some ways, is that a part of the process of education consists of making 
higher level behaviors lower level. That is, an activity which is initially com- 
plex, such as reading, becomes a lower level one as it becomes automatic and 
routine. Thus,, a goal of the educational process is to make complex operations 
so well learned that they become low level operations, and tools in turn for 
other higher level operations. 
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Reciprocal Category| System - The work with the original system (Flanders 
Interaction Analysis) has been summarized by Flanders (1965, 1970), and Amidon 
and Hough (1967). There are a number of modifications of the system, but only 
the one used in this research will be discussed here. 

The m(/dification by Ober, Wood, and Roberts (1968) offers a number of 
advantages over the original. ' The seven teacher categories of the Flanders 
System have been expanded to nine (see Figure 6): teacher lecture is divided 
into that which is responsive to pupils, ^and^that which is teacher initiated; 
and the category of teacher criticism has been divided into a category for cor- 
rection without criticism, and one for criticism. Category IQ remains silence 
and confusion as before. The major advance, however, is reformulating each of 
the categories so that they can be used for pupil talk as well as for teacher 
talk. That is, teacher amplification of a pupil's idea is categorized as a 3; 
a pupil amplification is a 13. Each categpry is changed from a teacher category 
to a pupil category by adding a **r' as the first digit. The observer, then, 
learns nine categories as he did with the Flanders System but has 18 to work 
with and, as a consequence, the same variety of pupil talk is recorded as teacher 
talk. This permits identifying the extent to which pupils do such things as 
maintain order in the classroom, correct subject matter misunderstandings of 
other pupils, build on each other's ideas, contribute information, or express 
and accept feeling in the classroom. Practically speaking, this modification 
offers more than twice the richness of the data provided by the original 
Flanders System at little increase in the complexity of the observer's task. 
In the second year's data. Silence and Confusion were broken into two categories 
Silence (10) and Confusion (20). 
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Figure 6 - Summary of Categories for the Reciprocal Category Syst 



em 



Category Number Category Number 

Assigned to Party 1^ Description of Verbal Behavior Assigned to Partv 2^ 



1 

\ 



Assigned to Party 2' 

"WARMS" (INFORMALIZES) THE CLIMATE : Tends to open_ up and/or eliminate 11 
the tension. of the situation; praises or encourages the action, behavior, 
comments, ideas and/or contributions of another; jokes that release 
tension not at the expense of others; accepts and clarifies the feeling 
tone -of another in a friendly manner (feelings may be positive or nega- 
tive; predicting or recalling the feelings of another are included). 

Accepts the action," behavior, comments, ideas and/or contri- 12 
butions of another; positive reinforcement of these." 

■ AiMPLIFIES THE CONTRIBUTIONS OF ANOTHER : Asks for clarification of, 13 
^^^^^^ on, and/or develops the action,, behavior, comments, ideas and/or 
contributions of another. 

^^^^^'^^^ Asks a .question or requests information about the content sub- 14 
ject, or procedure being considered with the intent that another should 
answer (respond). 

RESPONDS: Gives direct answer or response to questions or requests for 15 
information that are initiated by another; includes answers to one's own 
questions. 

INITIATES: Presents facts, information and/or opinion concerning the 16 
content, subject, or procedures being considered that ara self-initiated- 
expresses- one's own ideas; lectures (includes rhetorical questions — not 
intended to be answered) . 

^^}^}^^'- ^iv^s directions ,> instructions, orders and/or assignments to 17 
•which another is expecred' £0 comply. 



CORRECTS: Tells another that his answer or behavior is inappropriate 
or incorrect. 



18 



9 "COOLS" (FORMALIZES) THE CLIMATE: Makes statements intended to modify 19 
the behavior of another from an inappropriate to an appropriate pattern- 
may tend to create a certain amount of tension (i.e., bawling out some-' ' 
one, exercising authority in order to gain or maintain control of the 
situation, rejecting or criticizing the opinion or judgment of another). 

10 SILENCE : Pauses, short periods of silence. 

CONFUSION : Periods of confusion in which communication cannot be understood. 20 



2^ategory numbers assigned to Teacher' Talk when used in classroom situation 
j^- Category numbers assigned to Student Talk when used in classroom situation. 
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In using the Reciprocal Category System, an observer enters the class- 
room (or begins a tape), spends a few minutes getting the feel of what is going 
on, and then begins to write, at least every three seconds, the category number 
which best describes what is going in at that moment. If the activity changes 
within three secoixds a new category is recorded. As a consequence the observer 
can sometimes record four or five categories in as many seconds. While this - 
seems a very difficult job, eight to twelve hours of training make it relatively 
straightforward . 

A strength of this procedure (initiated in Flanders* .work) is the cap- 
turing, one step at a time, of the sequence of occurrences in the classroom, by 
the way the categories are tabulated into a matrix. ^ It then becpmes .possible to 
answer such questions as, "What does the teacher typically do when a pupil stops 
talking?" "What kinds of teacher behavior are followed by pupil responses?" 
"Does a teacher respond differently to a pupil initiation than she does to a 
pupil response?"^ "What proportion of the teacher talk is made up of criticism 
of pupils, followed by directions?" , ^ 

One of the interesting aspects of the matrix the RCS system produces is 
that it breaks down into four submatrices: teacher-teacher talk, teacher-pupil 
talk, pupil-teacher talk, and pupil-pupil talk. Along with this increased rich- 
ness of the data, the possibility is retained of returning the data to that of 
the Flanders System by pooling categories. As a consequence, relationships of 
these data to the store of information accumulated under the Flanders System 
can be studied easily. 

The original instrument is probably the best validated of any, if validity 
is defined in terms of the prediction of change in pupils. The relevance of 
teacher behavior as measured by this instrument to pupil achievement growth has 



been widely studie(gf, and relationships with pupil attitudes have also been 
found. ,A sma'ller number of researches show the validity of the instrument for 

. . \ ■ * 

predictijig such^things as pupil change in personality, growth i,n. creativity, 
and pegrcepti^jns of the nature of the classroom (Soar, 1966)". 



Observers and Trainin 



I. 



Three teams o^ two observers each were used, consisting of graduate stu- 
dents and research assistants. The first week of the quarter was spent in train- 
ing on the Teacher Practices Observation Record (TPOR); beginning initially with 
a presentation of specific categories by way of film clips, followed b^y observa- 
tion in classrooms, with discussion of differences in the categories recorded. 
The second week training was carried out on the Florida Affective Categories 
(FLAG) (Florida Climate and Control System the second year), using classroom ob- 
servation and discussion of differences from the beginning. ^ , The last day of the 
second week all teams observed in Follow Through classrooms in Jacksonville, to 
•complete standardization in the use of the observation systems. The third week 
all teams observed in Philadelphia, since the number of classrooms there w&s 
large enough that all three teams could work simultaneously and could meet after 
each day's observation to diocuss questions i^ais^d and agree on common procedures. 
This week represented the transition from, training to full-scale* work in the ^ 
iieid. In addition, some teachers seemed unusually uncomfortable about weaiing 
a wireless microphone. Finally, even with experience, the attention required by 
the equipment continued to be a distraction of some consequence to the observers* 

For these reasons, in numbers of classrooms the wireless microphones were not used. 

) 

For the second^ year, all of the recordings were obtained by observers moving 
about as inconspicuously as possible, carrying the tape recorder. Since the re- 
coffers were small battery-powered units, this was easily done. Although the 
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distraction to, the pupils was somewhat increased ini^tlally., it soor/ declined and 
seemed generally not to be a source of difficulty, The final procedure depended 
on choice of equipment to a large degree, and these details are presented in 
Appendix A. 

■ - ^ ^ 

In a free-play setting in a classroom with hard walls, floor and ceiling, 
"Tfc was di?fi~cliTtM:"o^ ilvtelTigibTe" recdfding , Hdwe\S^eF,~~an observer 

actually present in the classroom y^ill not be able to understand much of the 
interaction in such a setting. In general, the refined recording procedures . 
seemed^ to produce tape which was as understandable to fa coder as the live situa- 
tioA was to the observer. 



Apart from the technical difficulties, of making recordings in cla^rooms, 
therd were other difficulties. The typical Follow Through classroom is ary un- 
usually diverse one in terms of the variety of activities going on simultaneously. 
This, in turn, means that the^ complexity of the observer's task is increased 
several fold over what it would be in the typical classroom a grade level or two 
higher. It seems likely that the higher the grade level, in general, the simpler 
the~~oBserv^rJ^sj:ja5'k.; ^ven with two observers watching for different classes of 
behaviors, it is inevitable that some portion af what occurred in the classrooms 
went unobserved. On the other hand, with the .number of periods observed, the 
hope .that the classroom would be fairly accurately represented seemed reasonable. 

Another frequently occurriiig pattern of behavior made the observer's task 
difficult. In many classrooms, half a dozen or more small groups of pupils would 
be at work on different tasks. With adults with a number of M:he small groups. 
The typical behavior of the adult was to speak softly so as not to disturb other 



groups nearby. Pupils, to a greater or lesser degree, tended to fol 



low this^y^ 
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same pattern. As a consequence, it was frequently difficult to hear interaction 

between teacher, and pupils in a subgroup or to tape record it. The effect was a 

* 

quiet group in a noisy" room, or perhaps one not so much noiisy as busy. At the 
extreme, but not uncommonly, it was possible to sit directly at the elbow of a 
teacher working with individual pupils and be unable to hear a word that was said 

1 



b e t w e erTth e ^"Teach"eT^and*''t h^0" npupxl*: 



The activities coded from tape suffer a further disadvantage in that they , 
represent only the verbal activities in the classroom. This is not a particular 
problem with the Reciprocal Category System (RCS), since it is intended to record 
only verbal activities anyway. But for the Cognitive Taxonomy this is a somewhat 
greater disadvantage, A child may .be working with cuisinaire rods, building a 
stack of blocks with a repeating sequence of colors,, or carrying out a classifica- 
tion task by himself, and the^e would be no record of the cognitive complexity of 
this behavior recorded on the tape. To the extent that programs differ in the 
proportion of "the l^earning activities that take place in verbal interaction, their 
representation on the Cognitive Taxonomy wiM differ. 

On the other hand, the data collected from tape is relatively inexpensive 
in comparison to the cost of live data, so that it need add relatively little 
information to be justified. 

On the whole, the data recorded live are probably reasonably representa- 
tive of the classrooms observed, although certainly less than complete. The data 
taken from tape are probably less representative, and this will need to t^e recog- 
nized in the interpretation of the results. 

As another aspect of the overall procedure, data were collected on a num- 
ber of occasions from the Follow Through teachers in Jacksonville, toward an 
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analysis of the effect of the presence of an observer team over a period of 
time. Before these dat*a were analyzed, however, two studies were published 
that explored the question more extensively than would have been possible here, 
so the local analysis was dropped. 
Observer Effects 

The '^conventional wisdom** of workers in this area seems to be that the 
oFseWer soon becwe's*part of the woodwork for the pupils, if he never inter- 
acts with them and never takes part in any of the activities of the classroom 
(Medley and Mitzel, 1963). He probably ceases to be a matter of concern for 
the teacher much more slowly for most teachers; is never a concern for some 
teachers, and probably never ceases being a concern for others. 

Only recently have empirical data appeared on the question. Masling 
and Stern (1969) observ.ed two full days in each of 23 fourth and fifth grade 
classrooms, and correlated observational measures at differing separations xn 
time from each other. They hypothesized that the effect' of the observer should 
diminish in time, so that later observations'^should correlate more highly with 
each other than early ones would with late ones. They comment, "These correla- 
tions show no discernible pattern over time," and conclude that two interpreta- 
tions of the data are possible: ". . . (a) observer influence is negligible. . 
(b) the effects of the observer are more. complex than had been foreseen and 
affect various aspects of teacher and pupil behavior differntially. It is 
difficult to tell from the present data which conclusion is njore appropriate or 
even if both cannot legitimately be made" (p. 353). 

Samph (1968) made tape recordings without the teacher's knowledge, and 
compared these to behavior recorded live by an observer. Teachers' agreement 
to participate in a study of pupil behavior. was obtained, four microphones were 
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I 

installed in each classroom, and teachers were tcld^that recording would not be 
begun until after pupils had had time to get use^ to the presence ;of the micro- 
phones. A month later teachers were told that, recording wou^d soon begin, but 
it had actually begun ten ^ays after the mi;:'rophones were installed. During 
this early period, contrpl or baseline data were collected, using Flanders Inter- 

■ ' / i 

action Analysis. Following this, observers collected live data. , After the com- 

/ \ 
pletion of data collection, teachers were informed of the deception and their 

^. — . ^ ^ , 



permission to use^ the data was solicited. Teachers were also asked to indicate 
the style of teaching they thought ideal on the same dimensions studied in the 
research.^ 

The finding of primary relevance to this study is the comparison of the , 
baseline data to data collected when a previously scheduled observer was present 
in the classroom. Five variables from Flanders Interaction Analysis were tested 
fox significance of change (all comparisons were in terms of deviations of each 
teachei;; from her own ideal). Significant change was found for two of the five 
variables.: the amount of praise produced by the teacher increased when an ob- 
server was present, and the amount of criticism decreased. In each case the dif- 
ference between means for the control and experimental conditions was about three 
quarters of a standard deviation. Again, this is the variability of differences , 
between observed and ideal behavior for individual teachers, and probably i^ much 
smaller than the variability of behavior across teachers. 

None of the other three variables showed significant change. They were 
the total of teacher acceptance of pupil *s ideas, the I/D ratio (the ratio of 
the teacher's acceptance of feeling, praise, acceptance of ideas and questioning 
to her lecturing, giving directions, and criticizing), and the i/d ratio (similar 
to I/D, but omitting questions and lecture, the primarily substantive categories). 
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The changes were roughly a third of a standard deviation or less for these 
latter differences. 

It seems reasonable to assume that teaching is a difficult and complex 
task, and -that altering one's style is easiest for the more obvious^ aspects, 
such as praising pupils more and criticizing them less. By this interpretation 
the more complex measures of teacher behavior may have changed little, either 
because most teachers do not teach by a conceptual scheme that includes them, 
^ — oix-because-they— ar-e-more difficult to monitor. ^ 
Overall, even the statistically significant changes do not appear great 
in terms of the variability of behavior from teacher to teacher, so that it 
seems reasonable to assume that teacher behavior dpes not change greatly as a 
consequence of the presence of an observer. If the change a teacher makes is 
m the direction of a truer^ implementation of her philosophy as Samph*s study 
suggests, and if programs in\Follow Through follow different philosophies, 
then the effect of an observer N^hould be to sharpen program differences. But 
when it is recognized that the present study is analyzing approximately 400 
items of classroom behavior, it seems reasonable to hop^ that not many of them 
were affected very much. 

Analysis of Observational Data ' * 

As each five-minute observation period was completed, the nature of the 
activity was described briefly on a record sheet. After the data collection 
phase of the project was over, several schemes for classifying these activities 
were tried out. It was immediately apparent that not all activities that 
occurred could be separately classified without the data being so finely broken 
down that analysis could not be carried out within any one of the categories. 
The final classification scheme that was adopted was one which represented 
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simultaneously the degree of cognitive focus and of teacher direction; ranging 
from clear "teaching" situations, in which the objectives were clear to the 
teacher and to the pupils; to an intermediate level, in which the objectives 
were clear to the teacher, but the pupils might not have been' aware that the 
activity had an educational purpose (story time, for instance); to activities 
in which the nature and direction of the activity was a matter of the pupil's 
choice (free-play, for example). 

The conclusion was reached that analyzing separately by category was not 
functional on the basis of an initial factor analysis of the TPOR in which each 
activity by each teacher entered the analysis separately. For many teachers, 
then, three different sets of observational data entered the analysis, one for 
each activity level. As a check on the usefulness of this somewhat unconventional 
procedure, however, the data for all activities were pooled for each teacher, and 
the analysis repeated. An apparently clearer set of factors emerged, so that for 
all subsequent^ analyses ail observation data for each- classroom were pooled.. 

The next-'step in the analysis of each set of observational data was to 
calculate means and standard deviations for each of the items. Items wit'h ^very 
small means and/or variances were then^either eliminated or pooled with related 
items. Following this procedure, an area transformation was carried out item 
by item to make the data as nearly normally distributed as possible, and with 
approximately equal variabilities. The first of these considerations seemed 
important since many items showed essentially "J-curve^' distributions; and 
equality of variances was important because incomplete factor scores were to* be 
calculated later which would involve simply summing and averaging a series of 
items of behavior without further weighting. 



/ The data for each observation system were next factor analyzed separately 
using principle components factor extraction with multiple R squared* in the 
diagonal, followed by varimax rotation of a series of numbers of factors. Rather 
than relying on one or more of the various rule-of-thumb criteria for number of 
factors to rotate, a series of factors were rotated, and the output interpreted. 
The number of factors rotated which seemed to offer the clearest set of inter- 
pretations was retained; although on several occasions additional ^series of fac- 
tors were rotated, seeking greater clarification. Earlier research (Soar, 1966) 
had suggested that the usual criteria for selecting number of factors to rotate 
are not functional for observational data of this sort, and the results for 
these analyses continue to support that conclusion. Examination of the eigen- 
values, for example, shows that few factors were retained for which the eigen- 
value was less than three, and even fewer for which it was less than two. When 
factors were rotated to eigenvalues near one, the factors seemed unreasonably 
fractionated, or uninterpretable. 

After the decision had been reached about the number of factors to be 
rotated for each observation schedule, incomplete factor scores were calculated 
by simply pooling the T-scores for those measures which loaded -.4^0 or above^ 
on each of the factors. Although Glass and Maguire (1965) have criticized this 
procedure, Horn's comments (1965) seem more compelling. He points out that fac- 
tor analysis, as any other least squares estimating procedure, will capitalize on 
idiosyncratic variance, and that small numbers of subjects and large numbers of 
measures aggravate this probleifi. As a consequence, validity shrinkage on^ cross- 
validation becomes extensive. The incomplete factor score procedure cite^\^above 
minimizes the effects of idiosyncratic variances and validity shrinkage. 1^ 
does so at the cost of permitting factors to be correlated, rather than orthogonal, 
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as complete factor scores would be. This is the major criticism made by Glass 
and Maguire, but since this assumption is typically made only for computational 
convenience, it seems, the much less compelling issue of the two. Following 
the calculation of factor scores, differences between program means were tested 
using Duncan's rfew multiple range test (Dixon, 1970). 

In addition to the orthogonal rotations described above, oblique rotations 
were also carried out with each set of data for the first year using the simple 
loadings procedure (Jennrich and Sampson, 1966). In no case for any set of data 
did two factors correlate as highly as .3, and correlations above .2 were quite 
rare, sd that the varimax rotations were retained in all cases. (This conclusion 
applies^ to the complete rotated factors, not the incomplete factor scores). 

^These procedures (except for oblique rotations) were repeated for the data 
of the second year. Since factor structures differed to varying degrees from one 
year to the other, each year's structure was applied to both sets of data, and 
the structure retained whidh seemed clearest, discriminated programs best, or 
related most strongly to pupil growth. 

In the first year's analysis of FLAG, the affect items had been summed 
within the eight subsections (Teacher, Nonverbal, Supportive; Pupil, Nonverbal, 
Supportive, etc.), and the pools had entered into analysis. Subsequent analysis 
of items indicated that they were not homogeneous within a subsection, so in the 
second year's analysis of FLAGGS one factor analysis was carried out on the con- 
trol 'items, another on the affect items, and a third on the items that had loaded 
most heavily on each of the factors from the first two analyses. This latter 
analysis is the one reported. Because of the extensive revision of the instrument, 
no attempt was made to report both years' data on the same set of factors. 

The rating scales were also correlated with the classroom mean pupil gain 




measures for each year's data. Some items are the same, but some have been re- 
vised, others eliminated, and new ones added. The data are reported separately 
for each year. 
Analysis of Pupil Data 

Tl)e first year, SRI divided several standardized and^ experimental tests 
into parallel thirds to minimize testing time, and administered this battery in 
the fall and spring to a sample of Follow Through classrooms. Pre- and post- 
scores were available to this project for some of the classrooms in our sample 
from these administrations. The tests used in first grade included the Metro- 
politan Readiness Test, one of Deutsch's Early Childhood Inventories, and the 
Caldwell -Soule Pre-School Inventory. In kindergarten, in addition to these, the 
Lee-Clark Reading Readiness Test and the other Early Childhood Inventory were 
given. Data were available for at least half of the pupils in 20 first grade 
classrooms, and from 23 to 35 kindergarten classrooms, depending on the test. 
Additional measures were administered, but not analyzed because of missing data. 

These data were reduced to regressed gain scores and factor analyzed 
separately by kindergarten and first grade. Factor scores were calculated from 
these analyses, reduced to means by classroom, and these means were then cor- 
related with factor scores from the observational data. In addition, selected 
sets of data were studied by fitting curves to the rel.ations between observa-" 
tional data and pupil growth data. The usefulness of this approach was sug- 
gested by earlier work (Soar, 1968). 

The second year, SRI changed both the test battery and the grouping of 
pupils for testing, but .abbreviated versions were used again. Kindergarten 
classes were given the Lee-Clark Reading Readiness Test, two of the subtests 
from the Deutsch Early Childhood Inventory, the Caldwell -Soule Pre-School 
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Inventory, the Wide Range Achievement Tersx., and* a self-concept measure assembled 
from two existing measures. Entering firstXgrade classes (thoie without kinder- 
garten experience in Follow Through) were given the same battery. Nonentering 
first grade pupils (those with experience in Fol\ow Through kindergartens) were 
given the Metropolitan Readiness Test, two tests mkde of items supplied by sponr 
sors, the Wide Range Achievement Test, and ^e same s^lf-concept measure. The 
achievement tests were combined into measures called '^cjuantitative -computational 
"verbal -linguistic,*' and '^perceptual-motor/^- 

In our analysis of the first year's data, factor analysis of the gain 
scores from each grade level 'had produced two factors, one identified as Simple- 
Concrete, the other as Abstract-Complex, which correlated differently with the 
classroom observational measures. So it seemed desirable to attempt to create 
new groupings of items and subtests paralleling the factors identified in the 
analyses of the first year's data. 

Procedures paralleling those of-^the first year were fc^l lowed in a general 
way.,, except that the ne.ed to work with regressed gain for items as well as sub- 
tests created problems in the analysis (the Sponsor Books, and the WRAT to some 
extent, included heterogeneous items not grouped into conventional subtest form, 
with possible scores ranging from one to twenty). As a consequence, some of the 
subscores in the second year's data come from factor analysis, and others come 
from item analysis using a priori clusters of items or results from factor analy- 
sis as a starting point. , As before, factor scores were reduced to classroom 
means, and correlated with the classroom observation data. The details of the 
problems, the rationale, and the procedures which were evolved, are presented 
in Appendix B. 

In the first year's data, 55 of the 70 classrooms observed are repre- 
' - sented in at least some of the pupil data analyses. Some classrooms were 
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observed" for TFe sake of' program description which were known not to be in SRI's 
sample. In the second year's data, only 40 tlassrooms are represented in the 
analysis of pupil data. Again, some classrooms not in SRI's sample were followed; 
other reasons. -for loss of classrooms are detailed in Appendix C, 

Results 

Pupil Regressed Gain Measures ^ * . ^ ,.c — „„- 

As described in the procedure section, measures of Pupil growth differing 
in complexity or abstractness were sought from the measures administered by SRI, 
using factor analysis and item analysis. 

Achievement Data, 1969 - A two factor rotation for first grade and a 
three factor rotation for kindergarten are shown in Table 3, It can be seen ths^t 
there is considerable similarity across the two analyses, despite the larger num- 
ber of tests for kindergarten. In general, the Simple-Concrete measures require 
performance such as naming letters or numbers, ^performance which seems not to re- 
quire processing of information but only retrieval. The Complex-Abstract factor 
score, on the other hand, requires pupils to compare complex figures, to copy 
figures or shapes, or to possess broad information which is not particularly school 
oriented. 

Achievement Data, 1970 - ^n preparation for calculating regressed gain 
scores for the four subgroups of pupils defined by black, white, high social 
status and low social status, fall and spring means were calculated on each mea- 
sure. Table 4 reports results for the a priori composites of Simple-Concrete 
and Complex -Abstract pupil growth for the four subgroups. There does not appear 
to be a consistent tendency for more growth in blacks or whites, or for high or 
low social status to grow more during the year. The small differences that appear 
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Factor Analyses of Kindergarten and Fi;rst Grade 
Regressed Gain Scores - 1969 



Subtest Description 



Kindergarten 
Factors 

2 '3 



First Grade 
Factors^ 



h2 



-Lee^ClarlcJleadjLng.^eadiness^ 



1. Letter Matching 

2. Letter Cross-out 

3. Vocab. § Instructions 

4. Ident. Letters § Words 

Metropolitan Readiness 
-1. Word Meaning 

2. Listening 

3. Matching 

4. Alphabet 

5. Numbers 
6/ Copying 

Deutsch Early Childhood Inventory 

1. Pre -Math 

2. Pre-Science 

3. Pre-Positibns 

Deutsch Early Childhood Inventory 

1. Alphabet 

2. Numerals 

3. Shape Names 



Pre-School Inventory (Caldwell -Soul e) 

1/ Social Responsiveness .48^ 

2. Associate Vocabulary .54^ 

3. Concept Activation Numerical .Si" 
* 4. Concept Activation Sensory .27 



05 


62* 


9ft 






Test 




Al 


.48* 


.28 


.32 




not 




.03 


.54* 


-.04 


■ .30 




given 




.24 


.57* 


.16 


.41 








.46* 


.15 


.03 


.24 


.49 


.03 


.24 


.38 


.12 


-.08 


.17 


.36 


-.07 


.14 


.46* 


.32 


.09 


.32 


.39 


.20 


.19 


.33 


.22 


.46* 


..37 


.24 


.58* 


.40 


.28 


.31 


.24 


.24 


.-33 


.29 


.19 


.33' 


.20 


.16 


.18 


.44* 


.14 


.21 


.39 


.21 


-.03. 


.20 




Test 




.42* 


,01 


.09 


.18 




not 




.43* 


.00 


.26 


.25 




given 




.00 


.08 


.73* 


.54 


-.09 


.71* 


.•51 


.10 


.20 


.57* 


.38 


.20 


.62* 


.42 


.31 


.11 


.25 


.17 


.46^ 


.18 


.25 



.06 
.09 
.11 
,13 



.19 
, .25 
.34 
.32 



.28 
.37 
,38 
,19 



.39 
.54* 
.33 
.42* 



.38 
.35 
.22 
.13 



.30 
.41 
.16' 
.19 



Factor Title 



Complex- 
Abstract 



Un- Simple- Complex- Simple- 
named Concrete Abstract Concrete 



= 731 
= 476 

*■ 



Measures loading .40 or over were carried into factor scores. 
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Table 4 

Fall and Spring Standings for Four Kindergarten Subgroups 
on A Priori Composite Scores 
1970 



Subtest Description , 



Means 



Standard 
Deviations 



Raw 

N Fall Spring Gain Fall Spring 



Tomplex-Abstract LomposaTtF ^ ~ " — — 

Black, High SES 73 9.26 

Low SES 105 9.45 



12.15 2.89 2.67 ^ 2.61 
11.60 . 2.15 3.26 3.49 



White, ..High SES 
LcM SES 



36 12=.44 14.64 2.20 3.30 2.90 
35 11.09 13.71 2.62 2.99 2.89 



Simple-Concrete .Composite ^ 
Black, High SES 
Low SES 



73 12.16 17.89 5.73 4.28 4.55 
105 9.62 15.91 6.29 ■ 4.73 5.44 



White, High SES. 
Low SES 



36 14.72 20.61 5.89 5.90 2.33 
35 10.71 16.94 6.23 5.68 ,5.32 



^Preschool Inventory: Social Responsiveness, Associate Vocabulary, Concept 

Activation, Numeric 

^Early Childhood Inventory: Alphabet, Numerals 
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"show no consistent pattern to be associated with the particular subgroup. This 
conciusion was supported|bV tests of differences in regression coefficients for 
blacks and whites for a subgroup of the first year data (Honeycutt, 1971), which 
showed one significant difference for 13 comparisons. The t's were more often 
less than 1 (TaBle 5). , 

This was a convenience for the statistical analysis,, but more important, 
the implications that it ''has for education seem considerable.^ In the current 
climate of controversy, one issue of which revolves around the question of 



que 



whether black pupils are capable of learning abstract concepts (or whether lower 
class pupils are capable of such learning), the finding of such similar patterns 
of growth during school year is very reassuring. The black subgroups do start 
at a lower position and finish at a lower position than white subgroups do; and 
lower social status groups start and finish in lower positions than high socio- 
. economic groups do, but growth during the year appears to be similar. These 
' results appear to agree with those of' Hayes and Grether (1969) who found that ] 
the major differences between social status groups in the amount of academic 
^growth that took place during elementary schooJ occurred during the summers, * 
rather than during the school year. In their data, slopes representing growth 
during the school year were essentially parallel across socio-economic status 
groups, but they diverged during the intervals representing the summers. These 
data agree in general with that conclusion. 

The results of the factor analyses of tlie kindergarten and entering first 
grade data ar*:' shown in Table 6. It can be seen that there is considerable simi- 
larity acrossi the two factor analyses -- perhaps a surprising degree of similarity 
when it is recognized that the kindergartens were largely urban and northern, and 
covered a range of programs from contingency management to '^open" classrooms,. 



Table 5 

t-tests^ for the- Regression Coefficients of Pretest on Raw Gain ScJjjp^s 



Test or Subtest 

if 


First 
Black 


Grade 
White 


• t 


N . ^ ' 


190 


176 




liletropolitan' Readiness Test 








1 : Word Meaning 


-.54 


-.45 


.94 


2. Listening 


-.69 


-.74 


^3 


3. Matching 


-.63 


-.63 




4. Alphabet ' ^ 


^,73 


-.83 


3.07 


5 , Numbers 


-.45 


-.53 


1.06 , 


6. Copying 


-.44 


-.47 


.33 

« 


Early ChildKood Inventory (Deutsch)^ 








^,1. AlpHabet 


- . ox 


-.84 


.74 


2. Numerals 


-.73 


-.73 


.07 


3. Shape Names 


-.49 


•-.54 


.66 


Pre-School Inventory (Caldwell -Soul e) 








1. Social Responsiveness 


■ -.70 


-.76 


.67 


2. Associate Vocabulary 


-.53 


-.68 


1.49 


3. Concept Activation, Numerical 


-.53 


-.54 


.06 


4. Concept Activation, Sensory 

4 


-.77 


-.68 


1.07 



*p<.01 



Jl 



45 - 



Table -6 



Factor Analyses of Kindergarten and Entering First Grade 
Regressed Gain Scores - 1970 



Kindergarten , Entering 

Factors^ First Factors^ 

2 3 1 2 3 



Lee-Clark Reading Readiness 

1. Letter Crdss-out -.02 .04 .67* .45 .21 .20 .49* .32, 

2. Ident. of Letters 5 Words .08 .21 .43* .24 -.10 .08 .53* .30* 



Deutsch Early Childhood Inventory 

1. Alphabet .72* .05 ,14, .54 .67* .04 .06 .45 



2. Numerals .52 .04 .53 .55 .54* .09 .45* .50 

Pre-School Inventory (Caldwell- 
Soule) 

1. Social Responsiveness .21 .18 ,36 

2. Associate Vocabulary .09 .15 .35 

3. Concept Activation, Sensory .23 .21 .53 

4. Concept Activation, Numerical . 17 .19 .44 



.21 


.32 ■ 


.30 


.35 


.32 


.16 


.19 


.33 


.40*- 


.30 


.37 


.23 


.25 


.41* 


.29 


.26 


.10 


.32 


.34 


.23 


.34 


.05 


.07 


* 

.55 


.31 




-.02 


.28 


.32 


.19 



Wide-Range Achievement Test 

1. Name Spelling .36 .29 .35 

2. Copying Marks .25 .07 .26 

3. Spelling Words from Dicta- 
tion .00 .71* .14 \53 .19 .64* .11 .45 

4. Counting Dots .24^ .22 .14^ .12 .03 .02 .32 .11 

5. Oral Numbers .50 .02 .50* .49 .08 .60* .36^ .49 

6. Showing Fingers .20 .37 .41" .38 \15 .33 .71* .63 

7. Which Is More? ^ .23 .43* .13 .25 .22 .42* .33 .34 
, 8. Solving Oral Problems .24 .56* .17 .39 .12 .60* .28 .45 

9, Written Computation .13^ .70* .18 .55 -,10^ .67* .35 .58 

10. Recog. Two Letters in Name .53 .21 .14 .35 .47 -.06 .24 .28 

11. Naming 15 Letters .74* .07 .06 .55 .46* .40 -.17 .39 

12. Recognizing 10 Letters .33 .11^ .26 ,19 .26 .11 ^.03 .08 

13. Word Reading Aloud -.05 .78* A6 .63 .08 .67* -.01 .46 

Factor Title Simple- Skill Complex- Simple- Skill Complex 

\ Concrete Abstract Concrete Abstract 



In = 249 

2n =190 
* 

Measures loiiding .40 or over were carried into factor scores. 
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whereas the entering first grades were primarily^- rural and/or southern, and 
involved only three^ro grams, all stressing the personal -social develppment of 
children. ^ * ^ 

Comparison of Tables 3 and 6 shows extensive change- in the battery of ♦ 
tests administered to pupils from the first to the second year, so it is not 
surprising to find a different factor structure. As with the first year^'s ^ . 
analyses of the kindergarten, three f^actors were rotated, although one of these 
was a different factor. Two of the factors seemed to parallel the first year's 
analysis: a Simple-Concrete factor, and a Complex-Abstract one. Instead of the 
factor made up of the Lee-Clark in the first year's data, a new third factor 
emerged which appeared to represent skills-learning such as reading, arithmetic 
computation, spelling, and comparing quantitative concepts. This'latter factor 
apparently emerged as a consequence of the addition of the WRAT to the battery 
since it represents^ activities of thi^ sort to a high degree. 

The Abstract-Complex factor is rathex different in nature the second year, 
.^either the Metropolitan nor the Copying .Figures subtest from the Early Child- 
hood Inventory was administered th these pupils the second year, and these tests 
had been important contributors to the fiist year's Abstract factor. ^ Rather, two 
measures from the Lee-Clark, which had ^ade a separate fatctor in the first year's 
kindergarten data,^ were added to the facVor, perhaps because the instructions and 
the method of recording are complex, although the tasks do not appear to be. Also 
added to the factor was Numerals from the Early Cliildhoo^^nventory (which also 
loaded on 4he Concrete factor). Name Spelling (J^Qr the entering first grade), and 
Showing Fingers. All in all, these items seem closer to skill than the Abstract 
factor from the previous year. n 

\ 

Data reported in Appendix D show that at least the^Simple-Concrete factor 
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rank orders programs differently than the Skill and Complex-Abstract factors do, 
for kindergarten pupils. The small number of classrooms should not be taken as 
representing programs, but the different orders for the same pupils do suggest 
that the measures differ in the kinds of growth they reflect, .No differences 
which could not be assumed to be chance were found between entering fijrst grade 
program groups. But with nine classrooms, and three programs, noiie of which is 
, strongly skill -orrented, this is not surprising, ' - 

For the honentering first grade pupils, composites were created by item 
analysis, using criterion item groups created by both a priori and factx)r analytic 
procedures. These composites are shown in Table 7, In preliminary analyses of 
the data, the items tended to break up into those which had been individually 
administered, and those which had been group administered. As a consequence, 
Simple-Concrete, Skill and Complex-Abstract composites were created separately 
for each mode of administration. 

The relationships between these composites are shown in Table 8, The Gro^up 
and Individual Abstract scores are not highly related, but mode of administration 
(or the nature of the task), appears to make less difference' for the Skill and 
Simpl,e-Concrete measures. The Complex-Abstract and Simple-Concrete measures re- 
late at a low level, but Skill relates at a somewhat higher level with both of 
these. Overall, the pattern of correlations supports the concept of a dimension 
of degree of abstractness ^or complexity, with the three classes of measures 
spaced along it. 

The Simple-Concrete and Skill measures seem much like those ideiltified in 
the earlier two groups. The Individual Complex-Afestract seems relatively similar 
to that of the kindergarten-entering first data, but the Group Abstract seems more 
like the first yearns Abstract factor, with considerable overlap with the subtests 

ERLC . 58 
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Table 7 

t * f * 

Items Combined Into Subscores for Nonenteririg First .Grade, 1970 



Complex-Abstract 



Skill 



Simple-Concrete 



MRT"^ Word meaning 
Matching 
Copying 



Group 
MRtI Numbers 
SIG2 Word recognition 
' Majce ^ides equal 
Make 4 lines 



MRT-^ Alphabet 
SIG^ Count and wrifcV 
Order alphabet 



Add-Bal . Equation 



SI I'' Cone, Hidden Figures 
Verbal opposites 
Similarities 
Inconsistencies 

WRAT^ Oral problems 



Individual 
SII^ Reading Words 
Read nonwords 
Number reading 
How many 10* s 
Add and subtract 
WRAT-4 Spelling 

Which is more 
Written computation- 
Word reading 



SII^ Count from 
WRAT^ Reading numbers 
Name 13 letters 



•^MRT ~ Metropolitan Readiness Test 
2siG - Sponsor Items (Group) 
3sil - Sponsor Items (Individuals) 
\, ^WRAT - Wide Range Achievement Test 
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Table 8 

Correlations Between Subscores for Nonentering First Grade* 



^ Variable 







Var. 


1 


2 


3 


4 


5 


6 


7 8 9 


.Group 


Complex -Abstract 


1 


















Skill 


2 


.28 
















Simple-Concrete 


3 


.17 


.40 












Individual 


Complex -Abstract 


4 


.37 


.43 


.29 








/ 




Skill 


5 


.26 


.67 


.50 


.52 










Simple-Concrete 


6 


.19 


\42 


.68 


.25 


.44 


























Total 


Complex -Abstract 


7 


.87 


.44 


.29 


.83 / 


: 


.27 






Skill 


8 


.29 


.76' 


.44 


.50/ 


.98 


.42 


.45 
























Simple-Concrete 


9 


.20 


, .45 


.87 

f 


-/ 


.44 


.98 


.2o .44 



*N = 209 
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of the Metropolitan that entered that factor. 

The differences in the kinds of pupil attainment indicated by these 
measures" seem importhiit. Data reported in Appendix D indicate that when the 
same group of pupils in several programs is examined across the several measures, 
the program with the lowest mean pupil growth on the Grqup Complex -Abstract mea- 
sure, has the highest pupil growth on the Skill measure.. That is, although all 
of the measures reflect intellectual growth, the nature of the growth differs 
enough to be capable of reflecting differences in program. The numbers of class- 
rooms are too small to be representative, but the change from measure to measure 
for the same pupils seems important. 

This findiv»g points up another aspect of the test battery which seems 
important in relation to , program evaluation. That is that when simply totaled, 
the WRAT has about as many possible points by itself as the rest of the tests in 
the battery combined. Since it appears to be predominantly skill -oriented^ it 
has the potential of overdetermining any kind of battery total . Other tests con- 
tain some additional items reflecting skill attain^^.ent, whereas the items reflec- 
ting the broad, nonschool -oriented information in the Group Complex-Abstract mea- 
sure are relatively f6w. The small number of these items makes separating out 
the differing kinds of growth important in evaluating Follow Through. In addition 



the wide use and predictive power demonstrated in the past by the Metropolitan 



Self-Concept Data, 1969-1970 - For 1^69., self-concept data were available 
for both fall and spring on so few classes in sufficient numbers to analyze, that 
no analysis was attempted. 

In the 1970 data, adequate numbers of cases were available, but examina- 
tion of the items suggested that they were too diverse to simply sum, so factor 




Readiness Test (where the Group Abstract measure occurs) seem important. 
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analysis of fall and spring sfatus scores was carried out (to minimize the 
reliability problem). The loadings were marginal, however, suggesting that 
individual items were insufficiently reliable to support analysis for change. 
Further analysis of these data was not attempted 
Observational Measures and Their Relation to Pupil Growth 

The four instruments used for observation had over 400 items and measures 
^ of behavior. Medley and Mitzel (1963) point out that single items typically do 
not have high reliability, but reliability increases rapidly as items are pooled. 
Since many of the items could be assumed to overlap with each other, factor anal- 
ysis was used as a way of identifying clusters of behavior that tended to occur 
together, and independently of other clusters. As indicated in the procedure 
section, items with loading of ±.40 or greater were combined into incomplete fac- 
tor scores by summing algebraically, with equal weighting. These factor scores 
were then used to test for differences between programs using the multiple range 
test (Dixon, 1970). The homogeneous subsets reported in tables for each instru- 
ment, and the nonsignificant ranges shown in Appendix. D, represent subgroups of 
programs which do not differ significantly from each other. The presence of more 
than one subset or nonsignificant range indicates the existence of a significant 
difference between programs. These multiple rahge tests are presented in detail 
in Appendix D. " ■ ■ 

Teacher Pra ctices Observation Record (TPOR) - The factor structure from 
the 1970 data was chosen as the one on which programs would be compared for the 
two year data. The factors and their characteristics are described below. A 
summary of the results of the multiple range tests is reported in Table 9, and 
correlations of each factor with classroom mean pupil growth are presented in 
Tables 10 and 11. 
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Ta&le 9 ^ 

Teacher Practices Observation Record 
Multiple Range Tests of Program Discriminations 







3 




* 




1969 ' 


\ 


\ 

\ 

1970 , 




Factor 


Homogeneous 
Subsets 


■ F 


Homogeneous 
Subsets 


F 


1 - Pupil /Free Choice vs Teacher 
Stru^ured Activity 


4 


9.83** 


4 


8'. 76** 


2 - Experimental Teaching 


3 


4.25** 


3 


2.46* 


3^ - L^ss vs More Differentiation 


2 


5.67** 


3 


4.21** . 


4 - /Nonexperimental Teaching 


3 


9.67** 


4- 


8".67**' 


5 j- Intrinsic Motivation in a 
^ Task Setting 


2 


2.24* 


2 


1.54 


6 - Positively Focused Teaching 


5 


17.69** 


4 


11.74** • 




N = 70 Classrooms 

p < .05 
**p <C01 
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(1) Pupil Free Choice vs Teacher Structured Activity - This factor 
(Table 12) appears to contrast experimental teaching in the Deweyan spnse (the 
even-numbered items), with nonexperimental teaching (the odd-numbered items). 

The positive pole (the loadings with no sign) appears to reflect a great deal ^ 
of pupil freedom of choice, a rich variety of materials, and much activity and 
informality. All of the. items appear to be ones which might be checked in a 
free-play setting. Noticeably absent is much emphasis on the Nature of the 
Problem and Development of Ideas. 

The negative pole, in contrast, appears to represent a situation struc- 
tured by the teacher, with restricted materials and little pupil activity. Again, 
there is little representation of the Nature of the Problem or the Development of 
Ideas. In a sense this factor seems like a free-play vs **teaching" situation, 
but the teaching situation seems more like stage setting or cla.ssroom routine 
than teaching. 

The factor differentiates programs with aij 1- of 9.83 for the first year's 
data, and 8.76 for the second, both statistically significant. It does not 
relate significantly td pupil subject matter growth for either year, however. 

(2) ExperimontalX g aching - The essence of this factor appears to be 
the involvement of the pupil with a problem which is uncertain or incomplete. 
He is encouraged to explore,, to sit and think, to suggest alternatives, but 

f " 

is required to test his hypotheses and to be reai:^tic (Table 13). 

The factor differentiates programs significantly both years, with P's 
of 4.25 and 2.46, but does not correlate with growth for kindergarten pupils 
or^first grade pupils the first year. For entering first pupils the second 
year it correlated above .70 with \bstract (significant). Although not signifi- 
cant for the noncnLerlng first grades, it relates jn the .4()'s with Ciroup 
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Table 12 

Teacher Practices Observation Record 
Factor 1 - Pupil Free Choice vs Teacher Structured Activity 





I 
\ 

Item 


Loading 




Description 


2 


. 71 


T 


makes p center of attention 


4 


. 71 


T 


makes doing something center of p's attention 


6 


.70 


T 


has p participate actively ' • 


0 

o 


.60 


T 


joins Or participates in p's activities 


12 


. 82 


T 


organizes learning around p's own problem or Q 


32 


.74 


T 


has p make his own collection and analysis of 








subject matter 


36 


.72 


T 


jnakes a. wide range of information material 








avail able 


46 ' 


.42 


T 


has p decide when Q has been answered satis- 








"pji r* "t* o T*i 1 V 

l.Ci\^ L'KJ JL d. X y ^ 


54 


.82 


T 


has p work independently on what concerns p 


60 


.68 


T 


approaches- subject matter in indirect, informal 








way 


1 


-.53 


T 


occupies center of attention 


3 


-.69 


T 


makes some thing as a thing center of p's 








attention 


5 


-.68 


T 


has p spend time waiting, watching, listening 


11 


-.74 


T 


organizes learning around 9 posed by T 


31 


-.40 


T 


collects and analyzes subject matter for p 


35 


-.64 


T 


relies heavily un LeALuuoK as source of infor- 








mation 


53 


-.46 


T 


holds all p responsible for certain material 








to be learned 


59 


-.62 


T 


approaches subject matter in direct, business- 



Eigenvalue = 9 ,95 




60 



57 



Table 13 

teacher Practices Observation Record 
Factor 2 - Experimental Teaching 



Item Loading Description 



10 .57 T encourages p to express self freisly 

14 .76 T involves p in uncertain or incomplete situation 

16 .71 T leads p to Q or problem which (''stumps" him 

18 .42 ^ T emphasizes realistic, di-sconccrting, or "ugly" 

aspects of topic \ 

20 , ,61 T asks Q that is not readily answerable by study 

of lesson 

22 .74 T permits p to suggest additional oriialternative 

' answers I 
24 .62 T asks p to judge comparative value of answers 

or suggestions ' ^ 

26 , .70 T encourages p to guf^ss or hypothesize about the 

unknown ^or untested 
34 .45 T has p find detailed facts and information on 

^ his own 

42 .42 T withholds judgment on p's behavior or work 

44 .47 T encourages p to put his ideas to a test 

46 .54 T has p decide when Q has been answered satis- 

factorily 

48 .65 T asks p to evaluate 'his own work 

50 .49 T gives p time to sit and think, mull things over 

.45 ^ T approaches subject matt^. in indirect, informal 



way 



Eigenvalue = 6. 77 



/ 
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Abstract, and in the .SO's with Individual and Total Abstract \ It seems reason- 

/ » * \ 

able that a factor of thi? nature should relate to Abstract Grcjwth, .rather than 
to Skill or Concrete. 

(3) Less vs More Differentxation - The factor title ap pe.ars to be an 
adequate description for this factor, but with external^disciplinary pntrol 
supporting the undifferentiated activity (Table 14). It discriminated signifi- 
caivtly between programs both years.' Although the correlations with growth were 
n<fE^ignificant, they were Consistently negative. For nonentering first grade 
putrrr^7 tlie relation exceeded -.40 for the Group Skill measure, and for entering 
first for Skill. A number of other correlations exceeded -.30. The direction 
of the relation associates less differentiation with less pupil growth. 

(4) Nonexp^rimental Teaching - Although the' items -make ,cfear that teach- 
ing is under the close control of the teacher, the^control appears to be pri- 
marily one of keeping all the pupils together ii^what they are doing, and pre- 
venting 'pupils from straying in directions of^ their own (Table 15). Pupil plans 
which the teacher views as unlikely to be successful cannot be implemented, 
doubt and perplexity are prevented, hard questions or problems are avoided, and . 
pupils are not permitted free expression! To a considerable degree, the factor 
soom<:; to reflect a difference in orientation between, prograrpmed learning and an 
inquiry-orientation. ^ In tfie first, learning is broken, Tnto smaW steps, and 
questions which cannot be answered correctly at the time are avoided. In the 
second, hard questions,' exploration ,v and* free expression are encouraged. This 
fsictor seems to be the obverse of Factor 2, Experimental Teaching, in many ways. 
Its "flavor of closing off alternatives ejnphasizes the activity and involvement 
represented in Factor 2. Although experimental teaching is sometimes thought 
of as undirected, the "urging on" which characterized Factor 2 stands outisharply 

/ • ' 

O ' , A, ..." 
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Table 14 

Teacher Practices Observation Record 
Factor 3 - Less vs More Differentiation 



Item Loading . Description ^ 



17 .45 T emphasizes idealized, reassuring, or "pretty'* 

aspects of topic 

'51 .76 T has all p working at Same task at same time 

55 .56 T evaluates work of all p by a set standard 

61 .62 • T imposes external disciplinary control on p 

■ ■ / 

52 -.75 T has different p wording at different tasks 



Eigenvalue-. =^3.63 



Table ^5 



Teacher Practices Observation Record 
Factor 4 - Nonexperimen/tal Teaching 



Item - Loading Desciription 



T discourages or prevents p from expressing self 
freely 

T prevents situation which causes p doubt or 
perplexity/ 

' T steers p away from "hard" Q or problem 

T expects p to come up with answer T has in mind 
T expects p to "know" rather than to guess answer 
to Q 

\ , T provides p with detailed facts and information 

T Stops p from going ahead with plan which T 
\ knows wii:^ fail^* 

T motivates p with privileges, prizes, grades 

»> 4 ' * ' ' 

<^ - Eigenvalue = 4.52 V 70 



9 


.58 


13 


.71 


15 


.63 


23 


.44 


25 


.48 


33 i 


.41 


43 * 


.81 






57 


.59 
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if one reads the first two words of each item. It discriminated significantly 
between programs in both years' data. The factor correlations are not all in 
the same direction. It correlates significantly positively with kindergarten 
Abstract for 1970, but generally negatively with other Abstract measures. This 
is difficult to resolve perhaps simply the variability associated with smaU 
samples, ^ . - 

[(5) Intrinsic Motivation in a Task Setting - Although the factor is a 
diverse one, the central thread seems to be intrinsic moti\^ation and the pupil 
activity that goes with it (Ta^^le 16). Although the activity is convergent in 
nature, the teacher sometimes withholds judgment and evaluates by different 
standards. 

The factor differentiates programs significantly in the first year's 
data, but although two subgroups are created by the multiple range test in both 
cases, the differe^ntiation does not create a significant F in the second year's 
data, - 

The factor correlates above .40 with Skill, growth in kindergarten, above 
,40 with Skill for entering first grade pupils, and above ,70 for Abstract 
growth. For nonentering first grade pupils, all six correlations for Concrete 
and Skill growth are above ,40, The pattern of correlations suggests that the 
active involvement and excitement of pupils in learning activities facilitates 
growth 1 

^6) Positively Focused Teaching - The flavor of the factor is that of 

the teacher who is central asking questions which build on previous work, 

/ 

accepting' only answers wjiich agree v^ith her expectations, evaluating the pupil's 
answer immediately as right or wrong, and expecting the child to give evidence 
for his answer or helping, him to find arid correct his errors (Table 17). 

ERLC . . . 




Table 16 

acher Practices Observation Recotjd 

Intrinsic Motivation in a T^^sk Setting 













Item Loading 


Descriptiph 










/ 









6 
23 
42 
56 

58 



.41 
.42 
.48 
.64 

.70 



T h'as p participate actively 

T expectsv p to/ come up with answer T has in mind 
T withholds jiidgment on p's behavior or worlj, 
T evaluates work of different p b>^_^dL&fcrfent 
standa^rds 

T motivates p.jd-t4r^1vt?i-nsi-G— value^ of ideas or 
'activity " • 



Eigenvalue = 3.60 



\ 
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Table 17 ' 
Teacher Practices Observation Record 
Factor 6 - Positively Focused Teaching 



Item 


Loading 

- 


Description 




I 


AO 


T occupies center of attention 




1Q 
ly 




T asks Q that p can answer only if he 


studied the 






lesson 




.04 


T accepts only one answer as being correct 


25 


.51 


T expects p to "know'* rather than to guess answer 


30 


.58 


to Q 




T asks p to support answer or opinion 


wi th 






evidence 




31 


.58 


T collects and anaU^zes subject matter for p 


33 


.40 


T provides pupil wl%h detailed facts and infor- 






mation 




35 


.;? 


T relies heavily on textbook as sorffcc 


of 1 






information 




38 


.62 


T helps p discover, and correct factual 


errors and 






inaccuracies 




41 




T passes judgment on p's behavior otX 


'ork 


45 


17.2 


T immediately reinforces p*s answer as "right** or 


49 


.51 


"wrong" 




T provides answer to p who seems confused or 






puzzled 




59 


.55 


T approaches subject matter in direct. 


business- 



like way- 



Eigenvalue = 5.92 
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In contrast to Factor 4, this teacher is actively moving pupils along inla 
direction which she has determined; whereas in Factor 4, pupils are not so much 
being urged on as being prevented from straying in directions which seem to the 
teacher to be undesirable. Another contrast exists with Factor 2, in which the 
teacher gives pupils greater responsibility for their learning and divergent 
ideas are encouraged. 

This factor discriminates programs, more strongly than any other in the 
instrument for both years' data, with F's of 17,69 and 11.74. For nonentering 
first grade group, it rela.tes positively to the Group Skill measure above .40, 
and to the Individual and Total Skill measures .above .50. Although only sug- 
gestive, the factor also correlates negatively with Abstract growth in the .30's 

for nonentering first grade pupils, and in the .20's for 1969 kindergarten and 

♦ 

first grade pupils. 

In summary, the TPOR discriminates^ program s sign ificantly for five of 
the six factors both yearsT^'^ suggests that experimental teaching in the 
Deweyan sense fosters abstract growth, and that differentiation, intrinsic 
motivation and positively focused teaching support skill growth. 

r 

Florida Affective Categories (FLAG) -1969 - 

This instrument was modified extensively on the basis of the first year's 



work (and renamed). Because of the changes, data are nojt reported together for 



the two years as with other instruments, but separately -for each year's instru- 
ment. The extent to v^/hich each factor from the instrument discriminated between 

pirograms, and correlated with pupil growth, is indicated in Table 18. Details 

J* 

of program comparisons \are shown in Appendix D. 

\ 
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Table 18 * 

Correlation of Florida Affective^ Categories with Pupil Growth Scores 
and Multiple Range Test Program Discriminations - 1969 





Multiple J 
Range Test 


Kindergarten 


First 


* 

Grade'' 


Factor 


Homogeneous 
Subsets F 


Abs.2 


Concr.^ 


Abs. 


Concr. 


1 - Free Choice .vs Struc- 
tured Learning in 
Groups 


3 


7.60** 


.10 


-.08 


.37 


* 

-.06 


2 - Intermittent Work vs 
Group Singing or Games 


2 


1.21 


-.03 


.19 


-.02 


-.05' 


3 - Warm Emotional Climate. 


2 


1.54 


.14 


-.12 


.23 


.25 


4 - Teach^ Negative Affect 
vs Pupil Work and Social- 
ization with Adults 


2 


2.13 


-.26 


.02 


;23 


-.30 


/ 4 

5 - Pupil Free to Withdraw, 
Seek Reassurance, Pre- 
tend, or Express Nega- 
tive Affect 


2 


2.72* 


.11 


-.39* 


.22 


-.07 


6 - Teacher Neutral Control 
vs Teacher Support in 
Task Setting 


3 


* 

2.37 


-.28 


-.37 


-.55* 


-.12 



= 70 * p<: .05 

= 23 **p<,dl 

^N = 33 

''n = 20 
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(1) Free Choice vs Structured Uearning in Groups - The major pole of 
this factor seems to represent diverse activities in the cJ^assroom in which 
the pupil is free to choose what he wants to do and how he wishes to do it, 
(See Table 19). Movement, activity, interaction with other pupils, and ex- 
pression of positive affect appear to be the central theme of the factor,. 
While two measures seem a minimal identification of the other pole of the fac- 
tor, they support each other in indicating a task group which had been speci- 
fied by the teacher. This factor seems very similar to the first factor from 
the TPOR. The similarities of the titles reflect basic similarities in the 
factors, and the same programs stand at the extremes for this.-ELAC factpr and 
the TPOR factor for both, years* data. The finding that this factor has one of 
the highest F ratios for program discrimination, and separates programs into 
three subsets, along with a similar finding for the first factor of the TPOR, 
suggests that this dimension is^ one of the more important ones along which 
programs differ that is, that it reflects differences in program philoso- 
phies. The failure of such a powerful program discriminator to relate to 
growth of pupils seems an important finding. 

(2) Intermittent Work vs Group Singing or Games - This appears to repre 
sent as pattern of occasional work interspersed with socialization; .one of indi- 
vidual and small group activity in contrast to total class involvement in games 
and songs (Table 20). If discriminates two subgroups, but does not relate to 
pupil growth. 

(3) jVarm^ Motional Climate - All of the positive affect sums appear on 
this factor, plus some pupil negative affect with a lower loading (Table 21). 
It identifies two subgroups of programs, but the F is not significant and it 
does not relate to pupil growth. 

i • 76 
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Table 19 

Florida Affective Categories System 
Factor 1 - Free Choice vs Structured Learning in^ 



ng m "groups 



Item Loading Description 



3 


.70 


14 


.47 


18 


.56 


21 


. .73 


22 


.46 


30 


' .68 


33- 


.41 


55 


.42 


37 


.58 


43 


.46. 


44 


.78 


45 


.58 


S3 


.58 


11 


^ -.69 


12 


-.47 



Teacher moves freely 

Social group without adult 

Cognitive plan, pupil problem 

Pupil *s task related movement 

Pupil's aimless wandering 

Pupil's collaborative work or play 

Pupil talks to others 

Adult work, teacher initiated 

Pupil pretends adult 

Pupil uses materials 

Pupil uses play object itself 

Pupil pretends play object is something else 

Pupil positive nonverbal 



Task group with adult 
Task group without adult 



Eigenvalue = 6.74 



1 , 
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Table 20 

Florida Affective Categories System 
Factor 2 - Intermittent Work vs Group Singing or Games 



Item 


Loading 




Description 




20 


.55 




Pupil intermittent work 




29 


.46 




Pupil work .with socialization 




33 


.52 




Pupil talks to others 




42 


.57 




Pupil ''fiddles with" materials 




43 


.52 




Pupil uses materials 




1 


-.56 




Teacher leads singing, games 




10 


-.52 




Teacher directs with song, music ; 


- 


Eigenvalue =3.04 












* \ 
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Table 21 








Florida Affective Categories System 








Factor 3 


- Warm Emotional Climate 


1 


Item 


Loading 




Description 




15 


.57 




Pupil seeks information 




27 


.54 




Pupil seeks reassurance, support 




36 


.61 ' 




Pupil corrects others 




40 


.47 


• Pupil central - telling, showing 




47 


.48 




Pupil negative verbal affect 




48 


.74 




Teacher positive verbal 




49 


.79 




Pupil positive verbal 




52 


.46 




Teacher positive nonverbal 




53 


.56 




Pupil positive nonverbal 




Eigenvalue =4.48 
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(4) Teacher Negative Affect vs Pupil Work and Socialization with Adults 



The factor seems to represent teaclier negative affect in contrast to work and 
socialization (Table 22). It creates two subgroups of programs, but the F is 
not quite significant and it does not relate significantly to pupil growth. It 
seems surprising that neither affect factor relates to the growth of pupils. 

GS^) Pupil Free to Withdraw, Seek Reassurance, Pretend, or Express 
Negative Affect - This is apparently another factor which describes pupil free- 
dom, but a different sort of freedom than Factor 1 (Table 23). Whereas Factor 1 
appeared to describe pupil freedom in choosing and carrying out a task, this 
factor suggests pupil freedom to do a variety of other things (withdraw, follow, 
seek reasrurance, or even express negative affect). Another thread is that of 
the child fantasizing himself in an adult role and of taking responsibility for 
maintaining the classroom in an adult way. While the teacher is not directing 
or organizing, she is attending to several activities. The factor discriminates 
signifi-cantly between programs, making two subsets. One* of the correlations with 
pupil growth is significant a negative relation with Concrete growth in kinder- 
garten. In contrast, however, there is no suggestion that high standing on the 
factor inhibits Abstract growth. 

(6) Teacher Neutral Control vs Teacher Support in Task .Settings - In some 
ways this is a perplexing factor (Table 24). Two items warrant explanation. 
Item 5, ^'Teacher supervises pupil closely," represents very close supervision in 
which pupils carry out instructions a step at a time, under direction by the 
teacher. Item 6, '^Teacher immobilizes pupils,*' represents the intent of tho [ 
teacher to stop all movement or activity on the part of the pupils. The social 1^ 
activities can be pictured as occurring fleetingly,. even under teacher control. 
The negative p6le represents task activity and teacher positive affect. 

Er|c . / • ■ - 
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Factor 4 



Table 22 

Florida Affective Categories System 

Teacher Negative Affect vs Pupil Work and Socialization 
with Adults 



Item Loading 



Description 



6 


.44- 


25 


.55 


46 


.65 


50 


.62 


13 


-.44 


19 


-.53 



Teacher immobilizes, pupil 
Pupil sh>^, timid 
Teacher negative verbal 
Teacher negative nonverbal 



.Social grouping with adult 
Pupil absorbed in work 



Eigenvalue =2.94 



Factor 5 



Item Loading 



. Table 25 

Fl orida Affective Categories System 

Pupil Free to Withdraw, Seek Reassurance, Pretend, 
,or Express Negative Affect 



Description 



9 


.47 


22 


.68 


24 


.72 


26 


.40 


27 


■ .47 


32 


.60 


34 


.4-2 


37 


.56 


47 


.42 


51 


.56 



Teacher attends simultaneous activities 

Pupil aimless wandering 

Pupil withdrawn 

Pupil being near, following 

Pupil seeks reassurance, support 

Pupil talks to self 

Adult work, pupil ^initiated 

Pupil pretends adult 

Pupil negative verbal 

Pupil negative nonverbal 



Eigenvalue =4.25 



. so 
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Table 24 

Florida Affective Categories System 
Factor 6 - Teacher Neutral Control vs Teacher Support in Task Settings 



5 .58 

6 .47 



ERIC 



Item Loading - Description . 



Teacher ^supervises pupil / 
Teacher immobilizes pupils / 
14 ^ .52 Social group without adulti 

i7 ..61 — Cogni4;dve^plan-j-^oaohw--p^pabl-^m- 

28 .61 •» Pupil parallel play 



16 -.56 Pupil gives information 

20 -.47 Pupil intermittent w/rk 

52 -.44 Teacher positive nonverbal 

Eigenvalue =3.83 
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The f|.ctor.^iscrimin^ The difference 

in its nature from the control- id ent±fied-ln"F actor 1 is illustrated by the 
finding that one of the programs which stresses freedom of choice and selection 
of activity by pupils and which stood high on Factor 1, also stands liigh on 
this factor which reflects a kind of close control. Conversely, one of the pro- 
grams whose rationale encourages teacher control of subject matter placed at the 

/ y 

bottom of this fa ctor. Even in those^classropn^ s in which the items^^FepresffltiQ g . ^ 

close contro/occur most_jfrequentlv thev occur only ncca<;innany. i-hf^ufinf _| 

behavior occurring in classrooms in which pupil freedom is a of program 



rationale suggests that teachers may occasionally f^el^lie need to impose x^rder 
on a cl'\ssroom which has become more active anjd diverse than the teacher i^^ com- 
fortable with. These thoughts lead ta a post hoc interpretation: although specu- 
lative, perhaps the management of a classroom by a teacher can be thought of as 
having two aspects --a ^'structure," a set of limits or a sequence of activities 
within which she organizes the work of the classroom; and "control," the! indi- 
vidual interactions Between the teacher and the pupils intended to modify pupil 
behavior. Perhaps what this interpretation suggests is that for many teachers 
some minimum of structure is necessary and in its absence the teacher feels 
occasional need for firmxontrol . 

; 

The range of difficulties of implementing the various programs seems r^le- 
vant. It seems probable that a highly structured program which specifies a se- ^ 
quence of activities for teachers and pupils would be more easily implemented than 
programs which rely more on spontaneous behavior by the teacl^er. It does not seem 
surprising in a setting in which pupil autonomy is valued and structure minimized, 
that a teather should feel the occasional need to step in and stop activity. 
Helping the teacher develop alternatives without structuring a sequence of 
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activities appears to be a more ^ifficul-t teacher development problem. 

The factor correlates negatiVely with several pupil growt'h measures, sig- 
nificantly for kindergarten Concrete and first grade Abstract growth." It seems 
possible that the strong control represented by the factor may inhibit growth, 
or perhaps the inconsistency of occasional strong teacher control in a relatively 
free context may be sufficiently ..unpredictable to the pupil as to minimize growth 
in 'a, range of objectives. 

FIJAC appears to reflect a variety of ways in which teachers manage class- 
rooms. A major component of the variation in this management is accounted for by. 
Factor 1. An additional aspect of the control of the classroom is probably rep- 
resented by Factor \, one pole of which is negative affect expression by the 
teacTler. it seems reasonable to assume that this affect expression will be ' 
directed primarily at behaviors which the teacher wishes to minimize* Fdctor 6 
appears to represent occasional strong control^ in a generally fret situation. 
What seems, to be indicated is that the, .ways, in which classrooms are structured 
and controlled by teaqherl are complex, and" that ..the conceptual schemes we use 
may be too simple t,o represent them adequately. 
Florida Climate and Control Syst em (FLACCS) - 1970 

V ^ _ 

As noted in the procedure section,. the first year FLAG was revised ex- 
tensively and organized around the concepts of control of the classroom and « 
emotional climate. ^ Since the instruments differ in major ways/ tli^e data are^ 
reported separately for each year. The results of the multiple range tests are 
repprted in detail in Appendix D, and^ummarized briefly in Ta-ble 25. Corrcla- 
tion of the factors with pupil growth are reportej^ in Tables 25 and 26 

(1) Teacher Negative Control vs Teacher Warmth - This factor appe^r^ to 
represent the teacher who controls the, Classroom through the use of negative 
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affect (Table 27). Pupils work under rfelatVvely close supervision, and respond 
with passive resistance. The factor discriminates significantly between pro- 
grams but does not relate significantly to pupil growth. This seems a surpris- 
ing result in terms of the concern for emotio^l plimate which education holds. 

Among the classrooms which stood high- on^ the factor were several from 
big city schools which were undergoing change of^ administration in a context of 
neighborhood stress. The feeling of observers wH^ revisited these ^ame schools 
the third' year of the project was that they had changed cha^racter dramatically 
and. were again -warm and friendly. • . ' 

(2) Pupil Freedom vs Teacher Structured Activity - The central thread 
of the factor (Table 28) appears to be the contrast between various kinds of 
pupil freedom to choosV an activity, a coworker, i group (and they work with 
little supervision), in contrast to activities whic^ have been set by the teach- 
er, and are closely supervised. There appears td^b'e a strong parallel between 
this factor andTpactor l of the 1969 FLAG, as we^l as the TPOR for bath years. 

The factor discriminates programs highly significantly, but doejs not re- 
late to pupil growth. Again, tl>is finding appears to support the comment made 
in connection with FLAG Factor 1, that the factors which are strongest in dis- 
criminating programs often do not relate to pupil growth. 

(3) Warm Glimate - This factor is made up principally of both teacher 
and pupil expression of positive affect in various ways (Table 29). These items 

are supplemented by the teacher listening carefully to the child, agreeing with 

" ^ * ^ \ 

the child, and supervising closely, but it is largely pupil behavior. The fac- 
tor separates programs into three subgroups and discriminates significantly. It 
correlates significantly with kindergarten Skill , and at a lower level with 
kindergarten and entering first Abstract, and all three Skill measures for 
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Table 27 



Florida Climate and Control System 
Factor 1^ Teacher Negative \Control vs Teacher Warmth 



Lo adi ng _ Des cript i on 



7 .77 T gives orders, tonpands , , . 

9 .77 T uses sharp tone, 

15 .79 " T glares, frowns 

21 .60 V p passive resistance 

25 .45 P works with mxQh supervision 

30 .45 ^ ' P shows shame ,^ fear, \humility ' ^1 

36 .84 • T uses threatening tone 

37 ./2 ' T criticizes . , ' 

50, .78 T frowns * - " 

51 .63 T points, shakes finger^ \ • i 



26 -.48 P works with little supervision 

54 -.53 T gives individual attention 

55 , -.65 T sympathetic, warm (N.V.) 



Eigenvalue = 7.^2 
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Table 28 

Florida Climate and Control System 
Factor 2 - Pupil Freedom vs Teacher Structured Activity 











Item 


Loading 


Description 


\ 



17 

26 

31 

35 

38' 

49 

60 

62" 

63 



.80 
.57 
.81 
.76 
.47 
.41 
.63 
.48 
.42 



P freedom- to choose activity 

P works with little supervision 

P freedom to group 

P free time' 

P commands or demands 

P enthusiasti-c, happy (V) 

P chooses another 

P pats,' hugs another 

P enthusiastic, happy (N.V.) 



1 
3 

JO 
1*8 
25 
33 
43 



-.67 
-.45 
-.49 
-.42 
-.58 
-.64 
-.45 



T central 

T attends simultaneous activities 

T supervises pupil closely 

P seatwork w/o T 

P works with much supervision 

P time structured with T 

T draws all into group 



Eigenvalue = 7.-1-1 
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Table 29 

^ Florida Climate and Control System 
Factor 3 - Warm Climate 



\ 



Item 


Loading 


, Description 


10 


.41 


✓ 

T supervises p closeiy 


29 


.59 


P c^hows pride 


41 


.56 


T agrees with child. 


44 


.46 


T is enthusiastic, congenial 


46 " 


.67 


P sounds friendly 


47 


.65 


P agrees with another 


48 


.51 


P offers to share, cooperate 


49 


.49 


P enthusiastic, happy (V) 


56 


.71 


T listens carefully to child 


58 


.72 


P helpful, shares' 


61 


.59 


P smiles, laughs with another 


63 


.46 


P enthusiastic, happy (N»V.) 


Eigenvalue =5.26 





Table 30 

Florida Climate and Control System 
Factor 4 - Pupil Negative Behavior' 



ERIC 



Item 


Loading 


Description 


4 


.55 


T directs, with reas.on. 


14 


.77 


T tolerates deviant behWior 


19 


.43 


P speaks aloud w/o permiss^ion 


20 


.70 


1' engages in out-of-bounds behavior 


38 


.48 


P commands or demands 


39 


. 72 


P finds fault 


40 


.50 


T says '^thank you," etc. 


52 


.51 


P picks at child 


53 


.57 


P hits " 


57 


" .56 


T touches, pats, hugs child 

\ 


Eigenvalue =4.98 
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nonentering first. Only one of the correlations is significant, but the pattern 
appears to be relatively consistent. 

(4) Pupil Negative Behavior - A number of kinds of pupil negative affect 
Iexpressi9n and negative behavior appear in the factor '^(Table 30). Both the 
deviant behavior tolerated by the teacher (item 14), and the out-of-bounds be- 
havior of the pupils (item 20), are defined in terms of standards which the 
teacher attempts to maintain in the classroom, rather than in terms of observer 
standards. The teacher would apparently like the classroom to run differently 
than it does, but *'puts on a good ^^ce," The factor creates two subgroups, and 
discriminates between programs but does not relate to pupil growth* Some of the 
same classrooms described in Factor 1 were also high on this one. 

(5) Structured Teacher Behavior with Praise The, title reflects the 
strongest loadings, with additional structure in the teacher question or state- 
ment of a befiavior rule (Table 31). The negative pole of the factor suggests a 
gentle sort of t eacher control and related pupil behaviors, but seems too weak 
to warrant naming in the factor. The factor discriminates highly significantly 
between programs, creating three major subgroups. It also relates significantly 
positively with kindergarten Abstract and Skill growth. However, although not 

r' 

significant, there are negative correlations in the .30*s for Abstract growth 
in the nonentering. first grade, and in the .30's and :40's for the entering 
first grade for Abstract and Skill. This pattern of correlations suggest the 
possibility that this method of control on the teacher's part i^^unctional for 
the growth of young children, but as they become older it is no longer supportive 
of Abstract growth. The failure of these correlations to reach significance makes 
any interpretation doubtfuL, even though there is considerable consistency in 
the correlations. Alternatively, these may be small sample variations. 

o 90 
ERIC . 



\ 



- 80 - , 



Table 31 

Florida Climate and Control System 



Factor 5 - Structured Teacher Behavior with Praise 



r'- 
-f — 



Item 


Loading 


Description 




11 


.51 


' T questions, states behavior frule 




12 


.57 * 


T praises (control) 




18 


.41 


P seatwork w/o T 




32 


.68 


Materials structure T behavior 




42 


.71 


T praises (affect) 




8 


-.40 


T suggests 




28 


-.45 


P seeks reassurance, support 




48 


-.41 


P offers to share, coop. 




Eigenvalue =4.11 










< 

Table 32' 1 








Florida Climate and Contxol System 








Factor 6 - Pupil Conforming Behavior 






Item 


Loadin-g 


Description 




16 


.57 


T touches, pats 




22 


.64 


P obeys directions 




23" 


.49 


P asks permission 




24 


.47 


P follows routine w/o reminder 




28 


.42 


P s<ieks reassurance, support 




45 


.48 


P says ^'thank you,** etc. 





Eigenvalue = 2.97 
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(6) Pupil Conforming Behavior - The items soem generally to reflect a 
variety of conforming behaviors on the pa^t of ^pupils (Table 32), The factor 
dees not discriminate between programs; rather the F suggests that variability 
within programs is somewhat larger than that between programs. The factor does 
not correlate significantly with pupil growth, but the negative correlation 
with Group Abstract for nonentering first grade pupils approaches significance, 

(7) Effective Personal Communication - The thread that runs through 
this factor appears to be one of real personal involvement between teacher and 
pupils (Table ^33). Although the negative pole has only one item on it and 
consequently is not named, the impersonality of the teacher structuring pupils 
into a s^etting in which blackboard or audio-visual equipment serves as a teacher 
surrogate supports the interpretation. The factor discriminates significantly 
between programs, creating tnree subgroups. It correlates strongly and posi- 
tively with pupil growth the most consistently of any factor in the instru- 
ment. Although, some correlations are significant and others are not, with only 
three exceptions the correlations are relatively strong with measures of pupil 
growth across three subgroups of pupils. The factor appears to be a surprisingly 
strong one to have so few items in it. Probably it is symptomatic of a larger 
complex so that these items represent only a portion of the effective communica- 
tion. 

All in all, FLACCS appears to be sensitive to differences in programs, 
and probably even to periods of stress in schools; six of seven factors dis- 
criminated programs significantly, five beyond the one percent level Some 
factors describe behavior graphically (Factor 1) and others which seem incom- 
plete appear to tap subtle but appar'jntly powerful aspects of teacher-pupil 
interaction (Factor 7), 
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Table 33 
Florida Climate and Control System 
Factor 7 - Effective, Personal Communication 



Item Loading 



Description 



13 
43 

•44 
63 



.68 
.41 
.45 
.42 



T nods, smiles, for control 
T draws all into group i) 
T- is enthusiastic, congenial 
P enthusiastic, happy (N. V.) 



-.46 



T uses blackboard, A/V equipment 



Eigenvalue = 3.02 
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This instrument continues a pattern cited earlier, /in which the factors 




which discriminate .programs most strongly are often not^xhe ones that relate to 
pjupil growth. Factors 2 and 5 discriminate programs most strongly, and both 
represent aspects of the structure of. the classroom the relative balance of 

' ' / 

teacher structuring vs pupil freedom of choice, and, the teacher structuring and 
controlling pupil behavior by the use of praise. Yet neither related consistently 
to pupil growth through all three subgroups. In contrast, the two factors repre- 
senting supportive affect. Factors 3 and 7, do relate to measures of pupil gfowth 
across all three pupil groups not always significantly, but consistently and 
even highly. The implication, speculative to be sure, seems to be that the more 
objective, external, mechanical arrangements of the classroom are less important 

than the personal communication of warmth and support. 

Reciprocal Category System - The factor structure- from the 197D'data was 
selected as the one on which the ,1969 and 1970 data would be examined. The de- 
tails of program discrimination are presented in Appendix D, with a suininary in 
Table 34* The correlations ot the factors with measures of pupil growth are 
shown in Tables 35 and 36. The various measures are defined in Appendix E. 

(1) Drill With Teacher Acceptance and Pupil Initiation vs Teacher and 
Pupil Initiation . The positive pole of the factor appears to descril)e a setting 
in which interaction between teacher and pupils occurs in relatively rapid-fire 
fashion (Table 37). It does not appear to be a typical drill session, however, 
in the sense that the teacher talks more, takes time to praise pupils, to accept 
answers, and to do these things at some length* The only pupil talk which occurs, 
however, follows teacher talk, much of it after a teacher question. The fact 
that pupils do occasionally initiate also seems to imply that the setting is not 
as tightly structured' oy rapidly 'occurring as the typical drill session. The 
negative pole of the factor is not a strung one, but reflects initiation by both 
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Table 34 



Reciprocal Category System 
Multiple Range Tests of Program Di)scrimination 



196£ 



Factor 



Homo. 
Subsets ^4 P 



1970 



2 



Homo. 
Subsets 



1 - 



3 - 



5 
6 



Drill with Teache?: Acceptance 
and r'ipil Initiation vs 
Teacher and Pupil Initiation 

Varied Pupil Directed Inter- 
action 

Warm, Nonevaluative Teaching 
ys Teacher Correction 

Teacher Amplification in 
Extended Talk 



- Pupil Talk 

- Teacher Initiation with Pupil 
Interruption vs Teacher 
Question 



^.12' 



2.58 



7 - 



5.39 \ 



4.06 

2.15 

1.07 
1.18 



5.10 



Initiation 


1 1.30. 1 


4 ' 


4.97** 


8 .- Supportive Pupil Talk 


2 1.58 


2 


2.05 


= 70 


*p< .05 






= 65. 


p < .01 
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Table 37 

Reciprocal Category System 

Factor 1 - Drill with Teacher Acceptance and Pupil Initiation vs 
Teacher and Pupil Initiation 



Item Loading ' Description 



1 .44 Teacher warms,"* informalizes the climate 

2, .79 Teacher accepts 

4 ' .66 Teacher elicits 

11 .72 Pupil responds 

19 .62 Student response to teacher 7 

21 ^50 iiTeacher extended indirect / 

26 .75 Teacher narrow question i 

34 .57 Teacher- teacher flexibility 

'40^ .46 Teacher elicit-initiate, percent 

46 .67 Teacher talk 

48 .76 Drill 

52 .68 ^ Pupil initiation following teach^F indirect 

55 .67 Teacher indirect-direct/ percent 

58 .58 Total number of tallies for all; batches (raw) 

59 .74 Total teacher talk (raw tallies) divided by 

number of batches 




13 - .45 Pupil directs 

r8 -.46 Pupil initiation 

51 -.54 Inquiry-drill, percent 

56\* -.47 Teacher initiation, percent 



Eigenvalue =9.07 



r 
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teacher and pupils. Apparently the major distinction is between initiation and 
response. The factor discriminates significantly between programs both years, 
but does not relate to .pupil growth. 

-(2) Varied PupiJ Directed .Interaction This factor is labeled "varied" 
and "pupil directed" because "the only teacher talk which appears on it either is, 
responsive to a pupil question or is interactive with a pupil (See Table ^38.). 

l!ost items reflect pupil talk without teacher .involvement . The varieties of 

v* * . 

pupir-talk are unusual^ Pupils ask questions, initiate, direct, correct, and ask 
broad questions. The varieties of kinds of interaction betw^en^ teacher and pupil 
and between pupils are high. The factor presumably reflects a relatively free 
situation. * \ 

The factor discriminates significantly between programs both years.- It 
does not correlate significantly with pupilf. growth , but it approaches signif- 
icance for 1969 first grade Abstract, and also correlates low positive for 1970 
nonentering Group Abstract. 

, (3) Warm, None.valuative Teaching vs Teacher Correction . While the factor 
represents teacher warmth on the positive pole, the occurrence of two heavily 
loading items which involve acceptance as a ratio to other behavior.,^ and the fact 
that the negative pole of the fact03;^has an item which loads heavily for teacher 
correction, suggests that the dimension is basically one of teacher acceptance vs 
correction (Table 39). 

The factor does not discriminate programs significantly, although two groups 
are created in the 1970 data, nor does it relate significantly to. pupil growth. 
Although several moderately high correlations appear, they are inconsistent in 
directioli^ and probably represent small sample variability., 

(4) Teacher Antplification in Extended Talk . The heaviest loadings reflect 
teacher amplification (extension and use) of pupil ideas, but the picture of ex- 
tended teacher talk is supported by steady-state teacher talk, extended questions, 



. ' Table 38 
Reciprocal Category System 
Factor 2 - Varied Pupil Directed Interaction 



'Item Loading .Description 



5 .58 ^ Teacher "responds - — — 

10 .85 Pupil elicits 

12 f^-Ji^S^ Pupil initiates 

13 .61 . ' ' Pupil directs 

14 ' .57 Pupil corrects 

2S- .49' Pupil broad question ^ 

32 .62 'Pupil question,'" teacher question 

33 .69 Pjupil question, teacher response 

35 ..84 Teacher-pupil flexibility 

36 i87 Pqpil-teacher flexibility 

37 .79 * • Pupil -pupil flexibility 

38 .88 Total flexibility 

54 .60 Pupil direction and criticism 



Eigenvalue = 8.20 



Table 39 • ' . ^ 

Reciprocal Category System 
Factor 3 - Warm, Nonevaiuative Teaching vs Teacher Correction 



Item 


Loading 


Description 


1 


.43 


Teacher warms, informalizes the clj.mate 


17 
23 


.79 
.43 


Teacher acceptance-rejection, percent 
Xeaicher revised I/D * 


39 \ 


.84 


^^-^ Teacher accept-correct, percent 


8 


-.74 


Teacher corrects ~" 

Total number of tallies for ail batches (raw) 


58 


-.43 


Eigenvalue = 3.86 
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vand the average length of teacher initiation (•Table 40). The two minimally 
[loading items on the negative pole are not named, but there is a suggestion 
that the extended questions the teacher asks are not broad questions. 

The factor does not differentiate between programs. It does show a 
correlation with pupil growth significant at the one ,percent level, with 1969 
first grade Abstract growth, and minimal suppgr^t for this correlation for 1970 

nonentering first grade Group Abstract. 

r 

(5) Pupil Talk . The positive pole of the ^ctor is made up of various 
combinations of pupil-pupil talk and extended pupil talk except for the two 
items involving inquiry (Table 41). The rest of the factor suggests that these 
two items appear here because of the pupil talk component that enters inquiry, 
and because of the lack of drill activities. Jlie^^ctor does not discriminate 
between programs. Its correlations with pupil growth present a perplexing 
pattern. For 1969 first grade Abstract growth, it correlated significantly 
negatively at the one percent level. However, in 1970 for entering first grade 
it correlated positively at the five percent level, with Skill growth and for 
^ nonentering first grade with Group Skill ^d Individual Abstract. These cor- 
relations were. supported by correlations with all of the individual and total 
measures for the nonentej-ing group. For two groups of pupils then, the measure 
appears to be positively related to Skill growth, but in a third group it is 
significantly negatively related to Abstract growth. It is possible t.h^t -these 
are the occasional significant correlations which happen by chance, but this 
coriclusiop is hard to accept for several reasons. For the 1969 first grade data. 
Factor 4, extended teacher talk, relates posi^tively with Abstract growth; and 
Factor 5, pypil talk, relates negativiely to Abstract -growth. In effect, the cor- 
relations^ based on different factors, agree on teacher talk rather than pupil 
taHc. supporting Abstract growth. However, in the 1970 data, the 'correlations for 



Tabl-e 40 
Reciprocal Category System 





Factor 4 - 


Teacher Amplification in Extended Talk 

/ 






Item 


Loading 


Description 




3 




Teacher amplifies 




4 


.45 


Teacher elicits 




5 . 


,50 


Teacher responds 




23 


.54 


Teacher revised I/D 




41 


.75 


Teacher amplify direct;, percent 




42 


, .66 


Teacher ex':ended question 




44 


.51- 


Steady-st'jite teacher talk 




49 


,44 


Average length of teacher initiation 




12 


-.42 


< 

Pupil initiates 




27 


-.41 


Teacher broad question 





i'gen value = 4,70 



\ 



* 
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Table 41 
Reciprocal Category System 
Factor 5 - Pupil Talk 



Item Loading Description 



'11 , Pupil responds 

'20 .83 * Pupil-pupil talk ' ' 

^45 ,93 ' Steady-state student talk 'y^ 

47 .63 Student talk . 

50 .90 Inquiry 

51 .69 ^ Inquiry-drill, percent 



16 ?.v -,S1 Teacher talk, percent 



Eigenvalue = 4, 77 



\ 



\ 



/ 
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Factor 5. argue against this interpretation where pupil talk relates strongly 
with all^ measures but Group Abstract. A possibility may be that an idiosyncrasy 
in the 1969 Abstract growth data .could similarly affo^ct both correlations there 
(the N was only 20 classrooms), but the correlation of 1970 Group Abstract does 
seem to differ from the others.- 

(6) Teacher Initiation yith -Pupil Interruption .vs Teacher Question . This ^ 
factor apparently represents extended, teacher talk, much of which is initiation 
or lecture, but with pupils feeling free Vo break in (Table. 42), The negative 
pole has teacher questioning as a common thread running* thTO^gh the three items. 
The factor discriminates between programs at the one percent level both years. It 
relates sighificant^^.y to 1970 entering first Concrete growth, and correlates in 
the 40*s with 1969 first grade Abstrax:t growth, and with 1970 nonentering Group 
Abstract growth. Perhaps what the results for Factors 4, 5, § 6, may indicate is 
that there is a real relationship in the data which is obscured by the error as- 
sociated with small numbers of cases and difficult to identify. / 

(7) Teacher Direction vs Pupil Initiation . The common thread that runs' 
through the highest loadings for this factor is teacher direction, with an indi- 
cation that the direction is given at some length and accompanied by criticism 
(Table 43). There is also evidence that the amount of teacher talk is high in 
general, and that it crosses a variety of categories. The negative pole of the 
factor indicates pupil initiatipn in* two items and correction in a third. 

The factor discriminate'^s significantly between programs the second year, Ij 
but does not relate to pupil growth. \ V 

(8> Supportive Pupil Talk . The factor i^s made up entirely of supportive 
pupil talk, with no teacher involvement (Table 44). Although the discrimination 

between programs is not significant, the multiple range test creates two homogeneous 

/ 

subgroups each year. It does not relate to pupil growth. It appe.^rs to be a measure 

EEIc ./1G4 
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Table' 42 

Reciprocal Category System 

Factor 6 - Teacher initiation with Pupil Interruption vs 
Teacher Question 



Item Loading 



Description 



6 
18 
29 
31 
43 
44 
56 



.95 
.41 
.72 
.73 
.84 
.58 
.79 



Teacher initiates 

Pupil initiation 

Pupil substantive interruption 

Total pupil- interruption 

Steady-s.tate teacher initiation 

Steady-state teacher talk 

Teacher initiation, percent ' 



26 
40 
48 



-.41 
-.80 
-.44 



Teacher narrow question 

Teacher elicit-initiate, percent 

Drill 



/ 



Eigenvalue = 6.33 
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Table 43 
ReciproSal Category System 
Factor 7 - Teacher Direction vs Pupil Initiation 



Item Loading 



Description 



7 
16 
22. 
34 
44 
46 
53 
59 



X2 
14 
18 



.75 
.62 
.84 
.42 
.51 
.53 
.85 
.49 



-.4 7 
-.44 
-.45 



Teacher directs \ 
Teacher ^talk, percent 
Teacher extended direct 
Teacher-teacher flexibility 
Steady-state teacher talk 
Teacher talk 

Teacher directioti and criticism 
Total teacher ta^k (raw tallies) divided by 



Pupil 
Pupil 
Pupil/ 



number of batches 



initiates 
corrects 

initiation, percent 



Eigenvalue = 5.62 



Table 44 
Reciprocal Category System 
Factor' 8 - Supportive Pupil Talk 



Item ■ Loading 



Description 



24 
25 
57 



.85 
.90 
.65 



Pupil positive- participation, percent 

Pupil revised I/D^., 

Pupil warms, accepts, amplifies 



Eigenvalue = 2. 83 
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of interest in its own right, however, in the sense that a number of programs 
have among their objectives fostering supportive social behavior on the part of 
^pupils. This factor 'appears to 6e a reasonable representation of such an 
objective JLn^refl^cting the extent to which pupils praise each other, and accept 
and expand. on each other's ideas in the content of a task which is real ^to.them* 

The RCS is one of -the instruments coded from tape. It does not appear to 
be as powerful an instrument, either in discriminating programs or in relating 
to pupil growth, as the instruments coded live in the classx:pom. Probably this 
is not so mudh due to the instrument itself, or coding from tape, as to the fact 



that less sustained interaction; occurs with pupils at these age/grade levels than 
with older children. Although irrelatively strong correlations appear, they do' not 
do so with consistency, so tha^ithe conclusions are uncertain. To some degree 
this is probably small sample vamability, but the nature of the underlying 
relations remains unclear. 



1G7 



COgni;feiCTb Taxonomy (CogTax) > For the Cognitive Taxonomy tho first year 
factor structure was chosen^ for further analysis. As indicated in the Procedure 
section, the coding method differed from the first ,to the^ second year. The first 
year a tally was recorded every three seconds' tea tegory system), but each obser*- 
vation period was also scored zero or one as though the instrument had been coded 
sign system. Since that system appeared to be at least as effective in t^ms o£~ 

H 

\ 

both program discrimination and correlations with pupil growth, the coding the 
second year was done in traditional sign system fashion by coding each occurrence 
of each iiem only once in an observation period, regardless of the number of times 
it occurred. Details of program discrimination are reported in Appendix D, and 
summaTized in Table 45;^correlations with pupil growth are shown in Tables 46 ai^d 
47. 

(1) Highly Focused Learning Tasks , Tlie most heavily loading items In this 
factor seem to involve specific acade»r.iw task3: counting, arithmetic operations, 
comparing and copying letters and numbeis* Lower loadings appear for clajssification 
and the sum of all tho items at that level (Tabljs 48). 

Ilie factor separated programs into two groups the first year (not significant), 
and three groups the second year (significant). It correlates significantly with 
the 1969 first grade concrete pupil growth and the 1970 nonentering first grade 
Individual and^Total Skill Grdwth, with ether supporting co^elations. 

The finding that this factor which focuses onv skill orier^ted interaction 
relates to pupil Goncrete and Skill learning, but not to Abstract, seems very 
reasonable. 

(2) Narrow vs Broad Answer . Tiie positive pole of the factor is made up 

primarily of level four behavior, ajS^lication; the negative pole of level two, 

f ■ * ' 

translation (Table 49). Tlie level four item, "asks, tells who, what, where, etc." 

refers to a question such as, "Wliat is a lid for?", and the pupil's response. In 

xonjtrast, the question, "IVliat was the boy doing?", referring to a picture, would be 
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Table 45 



Cognitive taxonomy ■ ^ ^ 

Multiple Range_Tests of Program Discrimination 



1969 



Factor , 



Homo . ;^ 
■ Subsets • *iF.' 



1970 



2o 



Homo. 
Subsets 



1 - Highly Focused. Learning Taskfs 



2 - Narrow vs Broad ?^3wer. 

3 Moderately^ ^Oicused Learning' 
Tasks ' ' ^' 



2^ 



4, r Phont< 



.1.60 
1.61 
2.13 ' 
i.70* 



■ 2 



5 Information Giving; and Receiving 2.6P 
6- - Complex Thinking . '1 "^62 



N = 70, 
= 65 



*p < .05 
.**p < .01 



3.98** 

2..21*v 
• 3.15** 

2;,2L* 

.? . 56 
.59 



■ . / 



7 



4y , 
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Table 48" 
Taxonomy of Cognitive Behavior 
^Factor 1 - Highly Focused Learning Tasks 





... ^ 






Teacher ^ 




Pupil 


Itfem ^Loading Level 


Description 


Loading Item 



14 

•V 


.43 


3 


15 


..74 


3 


— 16 


.71 


3 


17 


.72 


3 

» 


23 


.50 . 


- 3 



^Classifies (1 attribute) and 

gives class name 
CpUnts „ . . 

Adds, subtracts; uses units, tens 

Compares letters, numbers-; copies- 
letters, numbers (while 
learning) 

Sum of interpretation • 

Median 



.47 
.69 
.65 



.72 
.54 
.51 



46 
47 
48 



49 
55 
66 



Eigenvalue = 5,67 



ERIC 



Table 49 
Taxonomy of Cognitive Behavior 
Factor 2 - Broad vs Narrow Answer 



Teacher . / . Pupil 

Item Loading. Level \ Description , /Loading Item 



1 Choral response 

22 ,.49 3 Makes comparisons 

26 .67 4 Asks, .tells who, what, where, etc. 

28 , .66 4 Reads 

29 .70 4 Sum of application . 




2 Seeks information / 

9 -.76' 2 Describes activity, Dictui*e,^etc. 

Reports experience. J Describes 
situation event. 

11 -.52 2 Asks, gives permission 

12 -.55 2 Sum of translation -.64 44 



.42 , 


34 


.47.- 


54 


.65 


58 


.43 


60 


.62 


61 


-.56 


36 


-.76 , 


41 


-.4'2 


43 



Eigenvalue = 7.12 
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a level two question, and illustrative of the negative pole of the factor. 
Contrary to what might be expected, the level four activities seem to be more 
focused on subject-matter, whereas the level two activities seem more general. 



and would, for example include '*show ^nd tell"» 

The factor separated programs into two groups both years, with the F 
significant the second year* „It related significantly negatively with 1969 
first grade Abstract growth*, but as strongly- positively, although not signifi,-^ 
cantly, with nonentering fijrst grade 1970 Individual Ab3tract growth. The 
directior^^of the relationship the first year indicated that higher level activi- , 

ties m the classroom were detrimental \td Abstract growth and simpler activities 

' ' ^ ' ' . 

were supportive of this growth, but the opposite was indicated the second year. 

A possible resolution of this conflict is that the first grades for 1969 were 

pr:^|iarny entering first grpides. The pattern of corr,elations suggests that the 

f. . . " * 

compH^ex classroom activities which were inimical to Abstract growth in 1969 were 

supportive of such .growth among nonentering first grade pupils, and that their 

greater experience in school laid a background to permit this. But the shifting 

relationships may, of course, be due ,to small' samples, a change in the pupil 

measures, or perhaps the change in the way tapes were coded. 

(3) Moderately. Focused Learning Tasks . . This factor overlaps with Factor 1 
in kinds of activities included (Table 50) , It is task-oriented, but appears to 
be less specifically focused. Whereas, Factor 1 was focused on .tasks such as count- 
ing, arithmetic operations, and the comparison of letters and numbers. Factor 3 
has its heaviest loadings' for the identification of more general similarities and 
differences, the sum of Xeyel :thxee activities (interpretation) and the median 
level of activity for the whole scale. ^ 

The factor separated programs into two sii^gfoups each year, but the F^s wiere 
not significant. The fa tor correlated negatively with both I970'1<indergarten Con- 
crete (significant) and with 1970 entering first grade Concrete (above .40). ^ 

113 
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Table 50 
Taxonomy of Cognitive fieWvior 
Factor 3 - Moderately Focused Learning Tasks 



Teacher 



Item Loading ' Level 



Description 



Pupil 



Loading . Item 



11 
12 

13\ 
14 , 

18 
.19 
21 
23 
65 



.52 

.46' 
.49 
.55 
.60 

.71 
.61 
.43 
.79 
.79 



2 
2 
3 
3 

3 
3 
3 
3 



Names pictures, objects, color. 






letter \ 


.55 


39 


Asks, gives permission j 






Sum of translation 


.43 


44 


Sounds' out word 


.54 


45 


Classifies (1 attribute), gives 






class name (vehicle, etc.) 


.61 


46 


Identifies similarities, differences 


.70 


SO 


Asks, ..gives reason 


.64 


51 


Performs learned task or process 




/ 


Sum of interpretation 


.75 


S5 


Teacher — Median -- Pupil 


.61 


66 



Eigenvalue = 8.37 



^ Table 51 
Taxonomy of Cognitive Behavior 
Factor 4 - Phonics vs Cl-assification 



Teacher ^ , - Pupil 

Item Loading Level Description Loading Item 



6 


.65 


2 


Sounds letters 


.75 


38 


13 


. 54., 


3 


Sounds out word 


.52 


45 


32 


.41 


7 


Sum of evaluation 






24 


-.46 


' 4 


Classification (2 attributes) 


-.48 


56 



Eigenvalue, = 4.20 
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It .also correlated significantly positively with 1969 first grade Abstract, 
above .50 for 1970^ entering first Abstract and nonentering first grade Indi- ■ 
vidual Skill. In this caiie, then, an activity which is significantly positively 
correlated with' Abstract growth is significantly negatively correlated with 
concrete growth with supporting non-significant correlations. Tli^ directions and 
sizes of the correlations are consistent across pupil groups. There is also a 
s^uggestion that a classroom process which supports Abstract growth for less edu- 



cationally experienced children shifts to supporting Skill growth for more .educa- 
tionally experienced pupils. 

(4) Phonics . The factor is a minimal one. Two items represent pnbnics 
work,- and another the teacher evaluating or seeking evaluation, versus a minimal 

, loading for classification on the other pole. (See Table 51). 

The factor discriminates significantly between programs both years. For 
1970 noner^tering first grade pupils, it correlates significantly negatively with 
Group Abstract, and abo^/e .50 negative, for Individual Abstract. It al^so correlates 
above .50 positively b^t not significantly with entering first Abstract, which is 
troublesome; (This group has the smallest number of classrooms of any.) 

(5) Information Giving and -Receiving . This is a factor which appears to 
represent exchange of iiiformation between teacher and pupil and simple translation 
of language into'behavior (Table 52). \ • . 

It discriminates significantly between pMgrams the first year but not the 
second. It correlates significantly with 1969 first grade Abstract and in the .40' s 
with J970 entering first Abstract; but significantly negatively with 1970 non- 
entering first gra^e Group Abstract. The direction of the two sets of correlations 
may mean that the lower cognitive level activities which support Abstract growth for 
first graders without previous school experience has become^ too simple and no longer 
fosters Abstract growth for first graders who have previous school experience ♦ Even 
^though these correlations are significant, other reversals raise continuing questions 



- 105 - 



(6) Complex Thinking . Th^ factor is coiicerned principally with the 
application of previous learning to a new situation including directing a 
learning game. Other items seem to support these activities (Table 53).^ 

The factor does not discriminate, programs either year, and the F suggests 
that variability within programs Cs^ at least a-s large as between programs. The 
factor d^s not correlate with pupil growth significantly nor in a consistent 
manner. 

The" data from this instrument and from the RCS which preceded it seem- 

w - ^> ^ 

preplexing. The data, from both' bf these instruments' show parallel contra- 
dictions from pupil group to pupil group in whethe^r low. cognitive level or 



tightly structured classroom activities relate to 



a given kind of pupil . growth. 



Similar kinds of contradictions appear from 1969 first grade data to 1970 . 

nonentering first grade data. These are in contrast* to the results from the 

two instruments used in live observation which followed expectation more 
* • • 

''consistently. 
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Tab 1^" 52 
Taxonomy of Cognitive Behayior 
Factor 5 - Information Giving and Receiving 



Teacher 



Item Loading- Level 



Des,cription 



Pupil 



Loading Item 



3 


.80 


1 


4 


■ .77 (/ 


"1 


5 


.84 / 


1 


8 


.48' / 


2 


10 


.48 / 


2 


11 




2 


12 




2 



Gives, receives information 

Seeks information 

Sum o ^/memory 

Gives^i follows directions 

Recognizes- word (sight reads) 

Asks^, gives permission 

Sum of translation * 



.83 
.54 
.46 



35 
37 
42 





/ 




Eigenva; 


ue = 6.10 / 


t 




■ / ■ • 

/ 






Table 53 






Taxonomy of Cognitive Behavior 






Factor 6 - Complex Thinking 






i 





Teachdr 



Item Loading Level 



Description 



Pupil 



Loading Item 



27 ;52 


4 


Applies previous learning to 










new situations 


' .69 


■ 59 


29 .42 


4 


Sum of application 


-.64 


61 


30 .55 


5 


Sum of analysis 


.49 


62 ■ 




2 


Gives j fol'lows directions 


■ .47 


40 




4^ 


Directs learning ggcme 


.45 


57 


Eigenvalue 


= 4.51 
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Relations of Ratings With Pupil Growth Measures . The relationships of . 
ratings with the growth of. various pupil groups are shown in Tables 54, 55 and * 
56. The relations taken as a whole are so inconsistent as to be of uncertain 
meaning. Several of the ratings seem to relate, strongly for norientering first 
grade .pupils, but do not relate for the other groups. Teacher congruence, for . 
example, relates relatively consistently, and in two cases significantly, with 
pupil growth for nonentering first, but does not relate at all for the other 
four groups. Reinforcement from adults relates fairly consistently with growth 
(although not significantly), for nonentering fir.st and entering first, but not 
at all for the other three groups. Reinforcement from materials relates strongly 
and ofjen significantly with growth for the nonentering first grade group, to a - 
essentially zero for entering first, but negatively for 1970 kindergarten Concrete 
and not at all for the other two groups. Clear Cognitive Focus relates positively 
for at least some measures in the three 1970 groups, but not for the oth^r two. . 
This measure seems to relate with , at least some measures in more groups than any 
other. For other measures, relationships appear to scatter sufficiently that 

conclusions are uncertain. . " , / 

I? 

Relations involving 1970 nonentering first grade stand out as different, 

\ ' -I ./ ^ ^ 

but it seems unlikely that the difference between those ratings and the 1970 

. • • I 

Jcindergarten and entering first results can be attributed to observer differences, 
since, the observers were spread across all three groups. Apparently, in this case 

' ■ ■ ■ / 

as with the .systematic observation data, the need i^s for more* classrooms^ so that 
the results can be held with some confidence/ ' < ' ' 

/ . 
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Table 54 

Correlations of Global Ratings with Pupil Growth - 1969 



Rating 



Kindergarten , . First Graded 

Abstractl Concrete2 Abstract Concrete 



Proportion 'of Interested Pupils 


. .34 


.11 


-.06 


-.17 


Intensity of Interest 




.28 


.1-8 


-.43 


-.09 


Pupil Groupings 




.02 


-.20 


• ;06 


.12 


Pupil Differentiation 




.08 


.04 


■ .21 • 


* .22 


Teacher Congruence 




-.01 


-.02 


-.15 


.02 


Teacher EmpatHy 




.17 ' 


.13 


' -.17 


.00 


Pupil Reinforcement from Pupils 




.08 


.09 


.04 


• 11 


Pupil Reinforcement from Adults 




.06- 


.09 


,-.32 


^."14 


Pupil Reinforcement from Materials 


, .08 


.15. 


-.01. 


.28 


Pupil Self Control 




.05 


.05 


.28 


.11 


Clear Cognitive Focus 




.12 


.20 


-".26 


y .2S 


Game-like Cognitive^ Focus 




.14 


.23 


-.29 


-.23 


Children's priginal Art Work 




* 

.44 


N .01 


.25 


-.14 


Room Displays and Artifacts 




.22 


7.18 


.27 


.36 '' 


Overall Emotional - Attitudirial 
Climate 




•40 


.15 


-.15 


*' .27 


Children's Happiness - Satisfac 


tion 


.38 


.23 

# 


-.01 


. r3 



1 



N=23 classrooms, p.05=.41 
'^N=33 classrooms/ p. 05=. 34 
^N=:20 classrooms, p. 05=. 44 



"^p 05 
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Table 55 

Correlations of Global Ratings with Pupil Growth- - 1970 , 



r 





Rating 


i 

Absi 


Kindergarter 
Skill 


Cone. 


Abs. 


Entering 
Skill 


Fi'rst2 
Cone. 




Pupil Groupings 


.-.44 


-.24 


- . 24 


.00 


- ; .21 


-.45 




Pupil Differentiation ' 


.12 


.35 


-.07 


-.40 


.08 


.43 




Teacher Congruence ' 


-.12 


.03 


-.22 


.36 


.11 


-.12 




Teacher Empathy 


-.13 


.02 


-.03 


'.21* 


.26 


.58 




"*Pupil Reinforcement from 
Pupils >^ 


-.16 


.02 


• 

M5 


-.08 


.23 


..U 




Pupil Reinforcement '-^^rom 
' " Adults 


.07 


.24 


-.11 


.51 


* 

.42 


J 

■..23 




• Pupil "Reinforcement from 
• Materials 


-.21 


* -.17 


-.42' 


' .37 


.00 


.29 




Pupil Self-Control 


.02 


-.16 . 


-.02 


. -.04" 


■ -.14 






Pupil Freedom to Interact 


-.42 


-.17 


-.18 


-.15 


.03 


-.18 




Clear Cognitive Focus 


.51* 


' .25 


.05 


■ .01 


-.07 


• 71 




Game- like Cognitive Focus 


.11 


.15, . 


-.09 


-.06 


-.15 


.38. 




Overall Emotional - 

Attitudinal Climate 
1 


.33 


.23/ 


. 10 


.04 


.12 


.33 




f 

Children Happiness - 
.Satisfaction 


.07 




.02 . 


.00 




.47 




✓ 

^N- 19 classrooms, p. 05=. 46 


1 

f 

■ - ' , *P 


.05 


> 







2m. 



N- 9 elassrootas, p.05i=.67 

/ 

/ 

/ 

/ 
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\ Nonlinear Relations Between Observational Measures and Pupil Growth . 
Earlier work had. suggested that relations between classroom behavior measures 
and pupil growth measures were, sometimes nonlinear, indicating that intermediate 
levels of seme kinds of behavior were most functional for the growth of .pupils 
(Soar, 1968). Further, this work had indicated that the level of a given class- 
room, behavior which was most supportive of pupil growth varied with the nature 
(the....aomplexity or abstractness) of the 1 earning -task . . In line with this, curves 
were fitted to the relations between the Abstract and Cod(Sf^e pupil growth 
measures and all of the classroom behavior measures for the 1969 first grade data 
(First grade was selected because relationships seemed stronger there*) One of 
the findings from .that an.ary^is is presented here as illustrative of the kinds 

/ 

of relationships found, but numbers of others followed the same pattern. -/Fabl^ 
57 presents the loadings for Factor 1 from the 1969 factor structure of the fpOR, 
and Figure 7 presents the curves. The deviations from linearity are not signi- ^ 
ficant CN=20), but the curve for Complex-Abstract growth suggests that the true 
relation *is^ not linear. Numbers of other curves support .that hypothesis. 

For the 1970 data'i^'. Figure 8 presents the relations betwe'^n FLACCS Factor 
6, ^pil Conforming Behavipr (Table 24), and Abstract, Skill, and Concrete growth 
measures for the nonentering first grade. The .suggestion of nonlinearity, al- ' 
though nonsignificant (N=12), again is present. Additional analyses of 1970 
data are not reported, since nonlinear analyses are more subject to error. due to 
small samples than linear analyses. These findings are not preociited as more 
than suggestive, but further analyses will be carried out with additional data 
for 1971.* 
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Teacher Practices Observation Record (1969) * 
Factor T - Teacher Directed Activity vs. Pupil Selected Activity .... ^ 

' ( : 

— — — 



27 .-.42 



ItW^- ""E^efecriptibn • ^ % ' 

^ , ^ — 

y^l ^80 . T'occupies center of attention ^ 

3 .72 " T makes kgip^ thing as a thing- center of p 's attention 
5 ;4S T has^p spend time waiting, watching, listening^ 

11 *.70 « T organizes learnings around Q posed by T 

^,13 ^ .56 ^ . T prevents situation which causes p doubt or perplexity 

.«'49 . .'5!2, T asks Q that p can 'answer only if he studied^ the. lesson, 

21 .84 • T 'accepts only one an/wef as being correct 

23 ^ .73 ^ T expects p to come up with answer T has- in mind 

25^ ^ ' - .55 ' . T expect/s p to "knowV rather than to guess answer to Q 

T accepls only aaswers or suggestions closely related to 
tdpifc. V , ' 

31 180. T collects and anaXy2es subject matter for p 

.',33 ^ .81 T provides p with detailed facts and information ; 

.35 .81. ' T relies heavily on textbook as source of information . 

45' . .73 T immediately -reinforces p's answer as ''right^Vor "wrong'* 

51' ^ .52 . T*has all p-working at same task at'same time 

5^^' - ^49 . T holds all p -responsible for certain material to be 

' ' learned 

55 .49 , T evaluates work of all p. by a set standa'rd 

57 ^ .63 \ T motivates p" with privileges, prizes, grades 

59' .66 X. approaches subject matter in direct, business-like way 

4 -.50 ^ » niakes doing something' center of p's attention. 
-6 -.40 \ J/ T has p participate' actively . 

12 -.73 " *■ T organizes learning around p's. own problem or Q 

32 ' -.72 ^ ^ T has p make his own collection and analysis of subject 

matter 

36^ -.53 T makes a wide range of infcrniation material available 

44 -.44 T encourages p to /put his ideas to a test 

54 -.71 T has p work independently on what concerns p 

60 -.68 ^ T approaches subject matter in indirect , informal way 



Eigenvalue = 12.81 
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If, however, the relations of ^ some of the behavior measures to pupil^ 
growth are nonlinear, the correlations reported here will be underestimated. 
Further, where the relationships are shaped iike inverted "U*s**, as some seem 
to be, the magnitude, and even the sign of a product-moment correlation may 
be changed with a change in the avejage level of the classroom behavior for 
^different subgroups being analysed. For some measures, ~it" is not unusual to 
find a ^change of a standard deviation or more in- mean level of behavior between 
entering first grade, and nonentering first-grade, for instance. It seems pos- 
sible, then, that some po^tioit of the vaxiabiiity of correlations observed may i 

be due to different segments of a curve being represented, as well as bv,s:i.all / 

\ I 

sample variability. | , 

i . 

Discussion . / 

Program Discrimination t^-- ^ ^ y 

One of the goals of this project was to describe/differences among thei 
programs in terms of observed classroom behavior. The analyses of variance / 
for observational data show that highly significant differences in classroom 
behavior ^re. associated with differences in Sponsorship. A major dimension/ of 
programs which runs through three different instruments over two years of 4ata 
collection with considerable consistency separates programs so v/idely that !there 
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is no overlap between programs at the extremes. Numbers of dimensions which are 
less clearly related to sponsor objectives as we understand them also disiriminate 
although less sharply. And of course, some factors show no differences^ lut they 
are typically dimensions which seem' to be unrelated to sponsor objectives!. 

There appear to be differences in the degree to which ^poi)Sors have been 
successful in implementing their objectives, and it seems probable that |tresses 
in communities, which are reflected in the schools, have negated the sponsors 



^ ' - 116 - ^ 

efforts in some cases. It also seems likely that programs differ in the dif- 
ficulty of implementation. Nevertheless, the success of sponsors h\ producing 
classrooms which reflect their objectives as they are measured here seems" 
striking. - ' " . 

Pupil Growth Data 

Although not an objective anticipated as part of this project, reduction 
of pupil achievement data to a small set of more homogeneous measures became a 
necessary first step. in preparation for .studying the relations between classroom 
behavior measures and pupil growth. 

Probably the most important finding' is that the total battery can be broken 
down into largely indepjendent subscores which reprefsent rather different kinds 
of learning. What has been called Simple-Concrete learning seenjs to require little 
but memory-; Skill rejpresents the acquisition of the traditional academic skills, 
reaciing, spelling and arithmetic; Complex-Abstract learning seems to require/more 
complex information processing — solving comp;Lex problems, comparing complex 
figures, the pqssession of abstract information. Not only do these different 
classes of scores not relate strongly with each other, but they seem to respond 
differently to the dimensions of classroom behavior and to different programs. 
For example, when the pupils in several programs are examined across the "three 

kinds of measures, one program goes from the lowest standing to the hiehest 

C 

standing. , - ^ V • " 

The finding of relatively independent classes of measures seems especially 
important since the total battery is more h<Javiiy weighted with items that re- 
present the Skill measure, so that a sum for the total battery would favor programs 
which emphasize teaching skills. In contrast, the Abstract measures which would 
seem to be closer to the objectives of the inquiry-oriented programs are repre- 
sented by a small number of items which would easily be overwhelmed in the total 
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battery. 

Beyond the issue of program evaluation, when these measures differing in 
nature are used to examine the growth of pupil subgroups differing in ethnic ^ 
group and socio-economic status, the minor differences in growth in either 
Concrete or Abstract measures are so inconsistent as to lead one to conclude 
that there is ho real difference. Subgroups start at different levels and 
finish at different levels, but grow at very similar rates for both Abstract 
aijd. Concrete pupil measures. This seems a very hopeful finding for a compen- . 
satory education program. 

Relations Between Observational Data and Pupil Growth 

In contrast to the use of observational data in program discrimination, th^ 
relations of the observational measures to measures of pupil growth are scattered 
and often inconsistent. Several problems contribute to difficulty in drawing 
dependable conclusions. Growth is the problem being studied, Bftt growth measures 
are much less reliable, and correlate much less' strongly with each other and with 
other measures-, than scores which represent standing at a point in time. Thorndike 
(1966) estimates that the correlation of a child's standing at , the- beginning of 
the year "with his growth during the year is probably nc^more than +.10. In con- 
trast, correlations between, standings for elementary pupils commonly approach +.70*. 
In these data, growth measures have been pooled, classroom by classroom, so that 
reliabilities have been increased, but to judge from' other studies, "high correlations 

are not to be expected. 

" The small number of classrooms in each group presented another problem — the 
largest number of firs^t grade? is 20, which requires a correlation of,. 44 to/be • 
significant. Numbers range downward to 9 which 'Requires a correlation, of .67 to 
be significant. It seems likely, then, that significant, correlations will be found 
only for real relationships, which are augmented by chance variation which happens 

ERIC • * . . . r ' 128 . . ^ 
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to fall in the direction of increasing the correlation. Many real relationships, 
then, will be obscured by the, overlay of chance correlations associated with small • 
samples. (Kindergartens have a slightly larger number of classrooms, but only 
rarely correlate significantly with any measure, the number of significant cor- 
relation^' being reasonably attributable to chance.) 

Against this backdrop of ^uncertainty, a few relationships will be cited 
which are identified by several significant correlations, supported by large but 
nonsignificant ones. 

Complex-Abstract growth appears to be fostered by several measures which 
theoretically complement each other. Experimental Teaching in the Deweyan sense ' 
appears tp be such a measure pupils are confronted by difficult problems, en- 
couraged to hypothesize and examine alternatives, but required to evaluate*the 
alternatives they have suggested (TPOR 2). Another is Intrinsic Motivation 
(TPOR 5), ref leating^ the involvement of the pupil' in the ideas and the activities 
themselves, rather than being motivated by teacher direction and evaluation. 
Additional, support seems to come from teaching which is not narrowly focused on . 
subject matter but is involved with the broader experience of the child an^ perhaps 
with his world out of school (CogTax 3) » The measure which seems to be most strongly 
supportive of Abstract.^growth is so brief as to be enigmatic, but appears to"^e- 
fleet effective personal communication between teacher and pupils in which pupils * 
appear to feel the teacher's involvement with them (FLACCS 7). In contrast, one 
measure appears to inhibit Complex-Abstrac^t growth: a measure in which the teacher 
occasionally exercises very close control oA^cr pupils in an otherwise little struc- 
tured setting (FLAG 6). It is not clear, however, whether it ^is the close control, 
or the inconsistent teacher behavior, or both, which have their effect. All in all, 
'this seems a reasonably coherent pattern of classroonj, behaviors, and one which it' 
seems reason^able to find' related to Abstract growth. 
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Pupil growth in Skill appears to, be related to a nuniber^pf the same 
classroom behaviors cited for Abstract growth. Intrinsic motivation (TPOR 5), 
Effective Person^lTcommunica^l^ (FLACCS 7), and Moderately Focused (partly 
non-school related) Teaching (Cog^T^ax 3) all appear to support the growth of skill. 
However, it is not supported by the Experimental Teaching £TPOR 2) which sup- 
ported Abstract growth. * . - 

Fewer measures appear to relate to Simple-Concrete growth. Teaching 'which 
is very specifically focused on lower level • academic skills promotes' Concrete 
-growth (CogTax 1), but more broadly focused teaching (CogTax 3) appears to 
inhibit it.. Effective Personal Communication (FLACCS/ 7) supports it, but ex- 
.treme freedom of action of pupils in the classroom (FLAC S) also appears to 
. inhibit it. . > : « . " 

There appears to be a kind of general trend which runs through these 
relationships which suggests that pupil Abstract growth tends to be supported 
by less controlled, less focused classroom activities than support Skill growth, 
and that Concrete growth is supported by still more specific teacher activities. 
Given the small samples, and the inconsistencies of the data, however, this is 
to a degree tentative. 

A somewhat surprising result is the failure of variables reflecting negative 
emotional climate to relate to measures of pupil growth. In contrast, two factors 
which reflect positive involvement of the teacher with pupils related to growtli; 
one was a very powerful correlate and the other approached significance. A pos- 
sible explanation for the difference in pupil response may be that disadvantaged 
children live with negative affect so commonly that it ceases to have much impact. 

If so., it would be reasonable to find positive affect variables having impact, 

/ - * 
as a kind of contrast effects 

In looking at the measures as a group and their relations with pupil growth, 

O it is interesting to note that factors which discriminate programs most strongly, 

130 
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and which represent major portions of the variance in the observational ddta, 
are not ones which relate strongly to pupil growth. The extent to which these 
factors discriminate programs implies that they represent an' important dimension 
along which programs differ perhaps a dimension whose poles are represented 



in contemporary educational thought by 
the one hand, and "open" classrooms ox^ 



relation just cited as well as the lack 
be the tendency for' these relationships 



the advocacy of programmed instruction on 
the other. ' ^ . 



A problem in the analyses of these data which may explain th6 lack of 



of significant results in general, may 
to be nonlinear. An examination of the 
first year data suggests tha^ measures of teacher control and pupil freedom re- 
late in nonlinear fashion to. pupil growth. The numbers- of "clas^srooms, within any - 
grade level group were too small to permit^a reasonable test of the hypothesis, 
but several bit's of data point to. this possibility. 



{ 



In summary, observation methods appear to be significant discriminators of 



at jleast some program objectives, but the relations between observational data 



and^ pupil growth" are less clear perhaps as a consequence of smaller samples of 
pupil data and the possibility of nonlinear relations. The Complex-Abstract, 
Sk,ill and Simple-Concrete subgroups of pupil growth measures which were created 
appeared to relate to program differences and observational measures in meaning- 
ful ways. 



/' 
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; Appendix A 
Equipment for Classroom Tape Recording \ 

The final pro.cedure involved the use of a moderately priced tape recorder 

and a Cardiod microphone (so-called because a graph of its sensitivity is some- 

what heart-shaped). This class of microphones is broadly sensitive to the front, 

*^ • * 

but sensitivity declines sharply to the rear, with the instrument almost com- 

^pletely insensitive directly to the rear. In use the micrephone Vas' not so much • 

directed at the sound to be riecorded,- but away from competing sounds. In addition 

/ . » ' ^ * > 

these professional microphones a^re materially more sensitive, tlian those furnished 

with tape recorders. ^ ^ - - \ 

* " • , * 

A further increase in recording quality was .gained from the use of x.**high- 

output" tape which is more sensitive to faint signals. ' ' - 

The choice of batteries' for the tape recorder' also was an important factor. 
Full voltage £s necessary to ol)tain the best possible recording. Zinc-arcid bat- 
teries (ordinary flashlight batteries-^ begin tJ.decline in voltage after^a few 
minutes* use and decline steadily. GE rechargeable batteries produce only 1.3 
volts instead of 1.5 at full charge, so that a set of five batteries j.n series 
produces a voltage a full volt below nominal value. Mai lory batteries and^ 
chargers were selected because they produce fulf >v.oltage which is sustained for 

ex^tended periods of time. 

; A fina-1* change was the provision of moderate quality earphones. Stereo 
earphones, rewired to function monaurally, were found to increase intelligibility 
over use of the speaker in the recorder, or earphones intended for transcription. 

The result of the various changes was that, in general, anything that a 
live observer could hear and understand in the"* classroom became codeable from^ 
tape. ^ 
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Appendix B 

Statistical Procedures Used in Calculating Pupil Gain Measures • 

• ■ y ■ 7 ' ' • 

Status vs Gain ^ ^ - ^- 

In assessing pupil growth, it seemed important to use ao measure of gain 
rather than a measure of standing at the end of the year, Gai,n measures are. 
more sensitive reflections^ of change than status measures, since the individual 
is being compajed with himself and his earlier status. Raw gain (the difference 
^ between post-test and pre-test) however, is generally an undesirable way ta re- 
flect change, because of regression effect. The concept of regression effect is 
that if two measures are less than totally reliable, a person who scores low 6n 
the first test will tend to score somewhat higher on the second; and' a person 
who score.s high on the first test will tend to score lower .on the second, assum- 
ing no real change from one test to the other. A parallel statement is that a , 
spurious negative correlation can be expected between the pre-test score and the 
difference from pre- to ptfst-score. When a period of. time infervenes between 
pre- and post-iest and growth occurs, the effect is less obvious but the spurious 
negative correlation can be expected to remain.. Its effect will be to increase 
the apparent growth of initially low scoring pupils, and to decrease the apparent 
growth'of initially high scoring pupils. As a matter of fact, in the first grade 
sample of data analyzed the first year, the median correlation between pre-test 
score and raw gain was -.61 acr6ss the 13 subtests of the Metropolitan Readiness 
Test, the Early Childhood. Inventory, and the^Caldwell Soule. Since this negar 
tive correlation's a measurement artifact and clouds relations of these measures 
with others, it seems desirable t'o remove it. 
Regressed Gain 

Regressed gain is a way of adjusting out regression effect. Its effect 
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is to adjust out that portion of gain which is associated with pre-test score, 

thus eliminating the spurious r3latiohship. In.She course of this adjustment,.^ ^ 

the gains of initially low-scoring pupils are decreased, and the gains of 

initially high-scoring pupils are increased, This adjustment, however, raises 

other difficulties, in turn, A regression effect takes place towatd the mean of 

the population bf wluch a given pupil is a member. The further aijK^y he is from 

the mean of that population, the greater is the adjustment which is madetj The 

problem,^ then,*is that if ipembers of two populations which differ in mean score 

are combined in an overall analysis, the gains of the members of the lowjr 

standing population will be reduced more than they should be, and the gains of 

he members of the high-scoring population will be increased more than tJjey 

should be. The usual solution to tliis problem, of course, is to carry out'^a 

separate analysis foif each population, . 

In the first year's data, this could not 'be done because demographic data^ 

were available on too few pupils, so regressed gain was calcul-ated separately for 

the total kindergarten group and the total first grade group. Within the second 

year data, four subpopulations appeared to warrant separate analysis, identified 

by ethnic group (white and black), and by social status {defined by the report of 

whether the pupil was entitled to full Follow Through services) • The difficulty,. 

however, was that a different test battery had ^een administered to kindergarten 

* 

pupils, ahd entering first grade pupils (those without previous Follow^Through 
kindergarten experience), from that administered to noneni?ering first grade pupils 
(those with previous kindergarten experience)* When these three subgroups were 
each divided into four subgroups, the numbers of cases became too small for 
separate analysis — as small as an N of three in one case. 

A different alteinative seemed reasonable if mean gain for each subgroup 
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appeared to be similar to that of the other subgroups within a grade level group- 
. ing- If mean gain from pre- to post- is similar for two groups, and if variabili- 
tie^s are similar, then thp regression of post-scpre on pre-score may reasonably 
be assumed to be the vSame, and the groups can be combined if the differences in 
initial standing can be "eliminated. This was th§ approach that was followed. 
Inspection of the pre-post means a.cross the va?:ious measures did not show consis- 
"^^ent differences from subgroup to subgroup in amount of gain (see table 4). 
Differences in the levels of the regression lines were, adjusted out for each item 
or subtest in the following way. If, ^or example., the low social^status white 
group'^stood three points lower than the high socia\status white group in pre-test 
mean, then three points was added to each pre- and post-test score in the white low' 
social status group. In this way, the amount of .change from pre- to post- was 
left unchanged, but the level of the regression line was shifted. Similar adjust- 
ments were made on all groups', so that the fouir regression lines should, in effect, 
become a common one. Regressed gain was then calculated for the coir.bined group, 
within each grade level group. 
Factor Analysis of Gain Scores vs Status Scores 

^^^^^lalysis of the subtest^Gores from the first year/s data i^idicated that 
the faclja3^-^1rrirctu^^ gain scores was appreciably different: from that 

of either pre- or post-scores. It was only in the analysis of regressed gain 
scores'that the simple-complex structure emerged cleariy.^^^f one is interested 
in gain, he should analyze gain. As Bereiter (1963) has indicated, items which 
are selected to measure standing at some point in time are likely to be items 
which ares quite ^stable, and consequently not good measures of change. It seems 
possible, then, that the factor analyses of regressed gain measures in the first 
year's data may have been identifying measures which were more sensitive to change 
than those which failed to load.^-« 
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These several considerations led to the assumption that the analysis of 
items and subtests to create new pools in the sfeco^d' year's, data paralleling the 
first year factors should be done using measures of chanj^e. The difficulty with 
this procedure, however, was the cumulative loss of reliability from change 
measures being much less reliable than the status measures from which t'hey are 
derived, and items being less reliable than subtests. ^f* \ T.- 

In one sense, the use of the term "items" is inappropriate dn that a num- 
ber of items on the WRAT (for instance. Word Reading, W = 20) have as long or i 
longer scales than subtests of the Metropolitan (Word Meaning,' N =. 7). But there 
were items With^ne and two point scales. 

Before items were factor analyzed, those which "topped out" or had very low 
vari-ability, wer.js eliminated. Despite the problems of measures with varying scale 
length occurring in the same analysis and the reliability problems cited earlier, 
reasonably clear structures were obtained from factor analyses of the kindergarten 
,and entering first grade, analyzed separately. In addition .to the simple and com- 
plex factors found the first year, a third factor emerged which was unexpected. 

i 

It appeared to represent skills-learning such as reading, spelling, and arithmetic 
^(the three R's!). It was apparently associated with the addition of the Wide Range 
Achievement Test (WRAT), which is heavily weighted with these skills. Incomplete 
factor scores from these analyses were used as the measures of pupil regressed^gltin, 

For the nonentering first grade data, items and subtests which appeared 
be abstract came together with a series of low-variance items which appeared to 
measure simpler kinds of learning. Inspection of the data also suggested a tendency 
for items to be grouped on the basis of whether they were individually or group 
administered. -Various combinations of items and subtests were combined and factor 
analyzed, but no really satisfactory structure emerged. Instead, on the basis of 
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the factor analysis and also a priori judgment, composites of items and subtests 
were formed to represent group and individually administered, simple-concrete, 
skill, and c.omplex-abstract measures. An item analysis of all items against 
tJ^ese composites was carried out, and items added to the composite accordingly. 
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Appendix C 
Table C-1 
Pupil Data Status - 1970 Samnie 





• ] 

; Kindergarten 


/ First 
/Entering 


I 

Grade | 
Nonenteringi Total 


Classrooms Observed 


— i 

/ 30. / 


15. 


25 


1 • 70' 


Classrooms , Missing Pr/ 
or Post 'Data ^ 

Classrooms Missing^ 
^'Demographic Data 


/ 

1 


6 
0 


13 

1 

• ° 1 


29 
1 


Classrooms Used in 
Pupil Analyses* 


19 


9 


1 
j 

12 1 


40 
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Appendix D 
Program Descriptive Data 

# ^ 
Pupil Growth Data 

Pupil growth data are not r.eported for the programs observed the first 
year* Demographic data were avail abfe for only a small fraction of the pupils 
on whom test data were obtained, and the estimation of regressed gain was 
carried out for the total group. Since this calculation for different groups 
combined creates a bias which is different for higher and lower standing sub- 
groups (see Appendix B) , and since programs differ in the ethnic compositions 
of the pupils served, comparisons would not have been meaningful. 

In the 1970 data, demographic data were available on most pupils for 
whom test scores were obtained, so that regressed gain could be estimated with 
the effect of economic status and ethnic group adjusted out. Although program 
comparisons are reported for the 1970 data, the numbers of classrooms involved 
are too small for. meaningful comparisons of programs. The data are reported ^ 
only for the light shed on the sensitivity of the different pupil gain measures 
to different program objectives. The changes in standing. for the same groups 
of pupils on the different measures suggest that different Aspects of pupil 
growth are being measured. The means reported are deviations around the grand 
mean of regressed gain for all pupils. 

The data for kindergarten growth scores are sho\m in' Table D-1 . The BE. 
program stands high for Complex-Abstract growth, stands high along with the 
Nimnicht program for Skill growth, but the Comparison group stands high for 
Simple-Concrete growth. 

In the entering first grade data (Table D-2), the only significant 
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' Table' D-1 " . 

Multiple Range Tests - Kindergarten Growth Scores (1970) 





Complex-Abstract 


* 

it. 






Skill 






Sponsor 


Mean NSR* 


S.D, 




Sponsor 


Mean NSR* S.D. 


N 


BE 


50.70 




• K)/ 


7 
O 




.50.51 


.09 


3 


Nimnicht 


50^07 




.31 


4, 


Nimnicht ■ 


50.21 


.32 


4 


Comp. 


49.91 




.76 


3 


Comp . 


49.82 


.16- 


3 


EDC 


49.88 




.13 


2 


Gotkin 


49.80 


> .10 


4 


Gotkin 


49.80 




.22. 


-4 


Bank St. 


49.79 


.06 


2 


Bank St. 


49.42 




.16 


2 


EDC 


49.69 


.01 


• 2 


r == 


3.46 N.S. 








F = 


8.81 N.S. 


•. 




- 






Simpl 


e- 


■Concrete 




t 


■ 




Sponsor 


Mean 


NSR* S.D. 


■ N 






- 


Comp. 




50. 77 






.31 


3 








EDC 




50.38 






.34 


2 








Nimnicht 


50.24 






.61 


4 








BE 




50.11 






.35 


3 • 








Gotkin 




49.51 




.61 


4 








Bank St. 


49.47 




.51 


2 


■ / 








F = 2 


.98 N.S. 













* 

Nonsignificant ranges. 



■N is the number of c^'lassrooms . One program with only one classroom is 
omitted .i 
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Table D-2 

* » * 

.Multiple Range Tests - Entering First Grade Growth Scores (1970) 





— 

Complex-Abstract 








Skill, 






/ 

/ 

/ 


Sponsor 


Mean NSR* 


S.D. 






Mean NSR* 




M 


Bank St. 


50.14 




.15 


3 


Bank St. . 


50.25 




.21 


3 


Comp. 


" 49.95 




.01 


2 


EDC 


50.06 




.31 




EDC ' 


49.93 . 




.02 


2 


Comp . 


49.79 




.35 


2' 


Tucson 


4-9.88. 




.18 


2 


Tucson 


49.68 




.41 


2 



2.30 N.S. 



1.71 N.S. 



Sponsor 



Simple-Concrete 



Mean 



NSR* 



S.D. 



Tucson 


50.33 




.16 


2 


Comp. 


50.. 12 




.34 


2 


Bank St.' 


49.96 




.08 


3 


EDC 


,49.76 




.04 


2 


F = 


3.95 N.S. 









Nonsignificant ranges. 

is the* number, of classroom?. 
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separation is for Simple-Concrete measure in which Tucson pupils show significantly 
more g^th than KDC pupils. Program orders change from measure.,to measure, but 
ho other differences are significant. 

In the nonentering first grade data (Tables D-3, and D-5), the mea- - 

sures are broken into Group Administered, -Individually Administered, and Total^ 
in addition to the levels of abstraction which were used in the first two groups. 
The BE program stands highest on all three of the. skill scores,. in each instance 
differing significantly from the lowest standing program. But on the Group - 
Complex-Abstract measure, the BE program stands lowest, and significantly dif- . 
ferent from the PF program which stands highest. Again, the only conclusions 
which "are appropriate have to do with the differential characteristics of the 
measures, not ^the relative standings of programs. 

The data do appear to point to the usefulness of measures such as- these - . 
for representing'differences in program objectives in program evaluation. 
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Multiple Range Test - Nonentei\ing First Grade Growth Scores (1970) 



Group AdmiMstered 





Complex-Abstract 






\ 


Skill . 






Sponsor / 


Mean^ NSR* S.D. 




Spoivsor 


Mean" NSR* S.D. 


N 




i)U . / /. 


0. 32 




3 


BE , \ 


50.35 


0.91 \ 


2 


,-ffininicht 


50.08 


'0..06 




2 


Nimniqht \ 


50.26 


0.88 \ 


, 2 ■ 


Tucson 


oU . 06 • 


0.'33 




3 


PE 


\S0.22 


1.63 


3 


BE- 


4y . 34 


1.20' 




2 


Tucson 


49.67 


1.03 


3 


r — 


2.48 N.S. 








F = 


4.27 N.S. 






i 
* 




Simpl 


e 


-Concrete 






* 


Sponsor 


Mean 


NSR* 


S.D-. 


N 








PE 


50.27 






0.33 


3 








BE 


50.10 






0.87 ■ 


2 








Nimnicht 


50.03 






1.29 


2 








Tucson 


49.82 






1.02 


3 








F 


= 1.15 N.S. 















* 

Nonsignificant ranges. 



N is the number of classrooms. Two programs with one classroom each are 

omitted. 
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Table D-4 

Multiple Range Test - NoD<;ntering First Grad^. Growth Scores (1970) 

Individually Administered ' 





Complex-Abstract 




Ski 1-1 




Sponsor 


Mean NSR* ^ S.D. 


Sponsor 


Mean NSR* S.D. 





PE 


.50.24 


1.76 


3 


"BE 


50.66 


4.90 


2 


Nimnicht 


50.13 


0.25 


2 


Nimnicht 


50.65 


0.35 


2 


BE 


50.00 


1.09 


2 


PE 


50.26 


7.65 ■ 


. 3 


Tucson 


49.83 


0.27 


3 


Tucson 


49.07 


2.43 




F = 


1.75 N.S. 

, i 






F = 


4 . /I N. b. 










Simpl 


e-Concrete 










Sponsor 


Mean 


NSR* S.D. 


N 








BE 


* 

50.46 




2.16 


2 








PE 


^ -50.39 




0.40 


3 








Nimnicht 


50.01 




2.59 


"2 








Tucson 


49.72 




1.14 


3 








F 


= 1.19. N.S. 













* 

Nonsignificant ranges. 



N is the number of classrooms. Two programs with one classroom each are 

omitted. 

\ ^ 
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Table D-5 

Multiple Range Test - Nonentering First Grade Growth Scores (1970) 

I Total 





Complex-Abstract 




Skill' 






-^■non COT* 


Mean NSR* 


S.D. N 


^ Sponsor 


Mean NSR* S.D. 


N 


PE 


50.32 




2.08 3 


BE 


50.56 


5.81 


2 


l^imnicht 


50.12 




0.32 ^ 2 


Nimnicht 


50.51 


0.53 


2 


BE 


49.89 




2.29 2 


PE 


50.24 


9.28 


3 


Tucson 


■49.87 




0.14 3 


Tuc son 


49.28 


3.46 


3 


F 


= 1.92 N.S. 






F = 


4.73 N.S. 

« 












Simple-Concrete 










Sponsor 




Mean NSR* S.D. 


■ N 








PE 
.'BE 




• 

50.33 
50.28 


0.16 
3.03 


3 
2 








NimnicHt 


50.02 


3.88 


2 








* • Tucson 




49.77 


2.16 


3 








F = 1 


.18 N. S. 






V 




*Nonsignificant ranges. 










In 

omitted. 


is the number of 


classrooms . 


Two programs 


with one classroom each 


are 



9. 
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Classroom Observation Data^--' 



In comparing classroon observation data from the first year to the 
second, several considerations seem important. First, more than^half of the 
teachers in the sample the first year were replaced the second ^year. Replace- 
ment ranged from none for one program to complete replacement for another (see 
Table 2). A number of teachers changed their teaching style in major ways from 
the first to the second year, as^seems reasonable to expect as programs mature • 
In addition, evidence of cro3s-fertilization and drawing together^of programs 
seemed clear on occasion the presence of Gotkin materials in other program 
classrooms, for examj^le. But, in contrast, in some urban areas, local problems 
contributed to tensions in the school which were reflected in the classroom. 

Despite these various influences, a considerable degree of similarity^ 
can be seen in the order of programs from one year to the next. - 
Teacher Practices Observation Record 

Factor 1 - Vupil Free Choice vs Teacher Structured Activity - In the 
"first year's data, EDC classrooms were separated from all others as showing 
greater .amounts of pujpil choice of activity; in the second year's data, Nimnicht 
classrooms joined EDC classrooms in separating from other programs (see Table D- 
Freedom of choice appears to be central to the EDC. program as it is described, 
and these data appear to agree. Probably the high standing of the Nimnicht pro- 
gram relates to the fact that pupils spend a considerable poi:tion of the day 
working with various kinds of audio-visual equipment of their own choice. 

In both years, Becker-Engelmann classrooms are identified as those in 
which most teacher structuring takes place. The emphasis on skill development 
through the use of programmed materials would seem to require that BR classrooms 
be rather highly structured with little pupil freedom of choice. 
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Table D-6 

Multiple Range Test - Teacher Practices Observation Record \ 
Factor 1 - Pupil Free Choice vs Teacher Structured Activity 



Sponsor 




196"9 






r- 

Sppnsor 




1970 






fTean 


NSR* 


S.D. 


N 


Mean' 


NSR 


* S.D. 


k 


EDC 


59.56 




1 


5.41 


8 


Nimnicht 


58.49 








5.45 


8 


Niinnicht 


53.36 








R 


FDf 


5:i.30 










R 


Bank St. 


= 51.29 






6.77 


8 


Tucson 


51.90 








4.20 


8 


Gotkin 


* 51.02' 






3.60 


8 


Bank St. 


50.01 








5.83 


8 


Tucson 


50.53 






6.20 


8 


PE 


,48.75 








6.06 


8 


PE 


49.96. 






3.92 


8 


Gotkin 


•48.66 








• 4.60 


8 


Comp. 


■ 45.55 






5.15 


, 14 


Comp. 


46.10 








4.38 


14 


BE 


4.1.38 






3.38 


8 


BE 


43.65 








3.34 


8 . 


F 


= 9.83 


P< . 


01 


->< — ■ — r-ir 




F = 


8.76 p< .01; 







Nonsignificant ranges." 



Table D-7 

Multiple Range Test - Teacher Practices Observation Record 
"Factor 2*- Experimental Teaching 





1969 








1970 






Sponsor 


Mean NSR* 


S.D. . 


N 


Sponsor 


Mean NSR* 


S.D. 


N 



EDC 
\Bank St., 
PE 

Tucson 
Nimnicht 
Gotkin 
BE 

Comp. 



54.15 
51.29 
51.05 
50.95 
49.67 
49.43 
48.02 
47.39 



F = 4.25 p< .01 



2.48 


8 


Nimnicht 


55.05 




5,43 


4.63 


8 


PE 


• 52.84 




3.97 


4". 0.8 ■ 


8 


Tucson 


51 .79 




7.77 


3.76 


8 


EDC 


51.38 




6.03 


1.96 


8 


Bank St. 


50.38 






6,59 


2.32 


8 


Comp. 


48.86 






.' 5.36 


1.78 


8 


Gotkin 


48.78 






4.08 


3.10 


14 


BE 


45.28 






2. 45 






F = 


2.46 p< . 


05 


!S . 



8 
8 
8 
8 
8 
14 
8 
8 



Nonsignificant ranges 
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This factor appears to be a major dimension along which programs differ, 
but it does^ not relate to pupil growth. 

Factor 2 - Experimental Teaching - The order of, programs differed some-^ 
what from the first to the second year's data (Table D-7)i In the first year's 
data, the EDC program stood highest on the factor with Bank Street, PE, anc^ " - 
Tucson; with CompaTiscn, Becker-Engelmann, Gotkin and Nimnicht classroojhs in a 
lower grouping. In the second year's data, the Nimnicht program movpd from the 
lower group to the upper group, and Bank Street became the program common to 
both groups. The shifrncrf the Nimnicht program may partially reflect the re- 
placement of seven of eight teachers from, the first to the second year's sample. 
Teacher variability within program is high in comparison to difference^ between 
means. . * 

Facto^^ 5 ^ Le-ss vs More Differentiation - With the exception* of the Becker- 

Eng^lmann program, programs go in roughly the same order in both years' data (see 

Table D-8). Ignoring it for the moment. Comparison groups are at thiS end of the 

* 

scale showing less differentiation of activities, ,with EDC, Tucson, and Nimnicht 
at the other end of the scale. Becker-Engelmann classrooms reversed position from 
least differentiation in the first year's data to most differentiation in the 
second year's data. This change took place as a consequence of an observer ground 
'rule change. In the first year's data, observel^a. tallied only what theycould see 
or hear, but since subgroups sometimes went to different rooms (where only this , 
subgroup was present), such a group was talliedj|^s undifferentiated. In the second 
year's data, however, a subgroup was tallied as differentiated if the observers 
knew that other subgroups from that classroom were engaged in other activities, 
regardless of the fact tljiat these behaviors were not observable. 



Factor 4 - Nor 



experimental Teaching - This factor discriminated between 
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Table p-8 

Multiple Range Test - Teacher PracticSs Observation Recdrd 
Factor 3 - Less vs More Differentiation 



1969 



1970 



Sponsor 


Mean NSR* ■ 


S.D. 


N- - 


Sponsor 
— ^ — 


Mean 




NSR* 


S.D. 


^ N 


BE 


S5.45 




^5.30 


8 


Comp. 


55.97 








7.11 


14 


Comp . 


53.90 




"5.50- 


14 


^ Gotkin 


54.60 








5.66 


8 - 


Gotkih 


51.95 




3.54 


8 


Bank St. 


49.33 








6.39 


8 


Bank St. 


51.75 




4.75 


8 . 


PE 


49.00 








4.84 


8 


PE 


• 49.38 






3.04 


8 


Tucson 


47.83 








6.55 


8 


EDC 


45.93 




6.20 


8. 


Nimnicht- 


47.63 








4.13 


8 


Nimnicht 


45.08 




5.34 


8 


BE 


47.13 








5.19 


8' 


Tucson ■ 


44.65 




4.88 


8 


EDC 


45.95 


i 


< 




3.23 
























F = 


5.67< p 


.01 




* 


F = 




A. 21 


P< ■ 


01 


^ 



•Nonsignificant ranges. 



Table D-9 

Multiple Range Test - Teacher Practices Obsekvatiori Record 
Factor 4 - Nonexperimental Teaching 



1969 



1970 



Sponsor 



"Mean NSR* 



s.d; 



N Sponsor 



Mean 



NSR* 



S.D. 



M 



BE 


58.29 


3 


70 


-8 


BE 


57.28 




4. 


71 


8. 


Comp I 


51.51 


4 


80 


14 


Comp. 


53.98 






5. 


on 


14 


Bank St. 


49.78 




2 


78 


8 


Bank St. 


53.75 






6. 


65 


8 


PE *' 


49.69 




2 


89 


8 


Gotkin 


50.70 




4. 


07 


8 


Nimnicht 


47.98 


, 3 


83 


8 


Tucson 


48.24 






3. 


32 


8 


Gotkin 


47.37 


2 


93 


8 


PE 


46.65 






. 2. 


81- 


8 


EDC 


47.22 


2 


27 


8 


EDC 


45.53 




3. 


96 


8 


Tucson 


47.02 


2 


07 


8 


" Nimnicht 


44.03 




3-. 


13 


8 




9.66 p< 


01 






F = 


8.67 p< 


.01 









^ Nonsignificant ranges. 

\ 
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programs significantly in both yeaVs data (Table D-9). Becker-Engelmann class- 
rooms stand high, alone in the first yeat^^s data, and together with Comparison ' 
and Bank Street classrooms in the second. The high standing for BE seems to 
represent the^bjectives of the program. The lower ^end pf the factor shows con- 
siderable variability in .order, except for EDC which retains a position toward ' 
the lower end both years. This seems^to agree with objectives' as well. 

Factor 5 - Intrinsic Motivation in a Task Setting - In the first yearns' 



/ 



data, EDC and Bank Street were separated off at the upper ^end; the second year,' 
BE, Banl^ Street, and Gotkin were at the upper end of the scale (Table 
Although contingency management programs make extensive use of extrinsic motiva- 
tion, the sequence of activities which build involvemerit have warranted checking 
the item for intrinsic motivation with some frequency in these qlassrooms. 

Factor 6 - Positively Focused Teaching - Programs are widely'keparated 
by this factor arid the F's are the largest for both years (fable D-11). The BE 
program stands high and is widely separated from the next highest program both ' 
years. The EDC pr9gram ^ands lowest and is widely separated from the rest of 
the programs in the first ye^x^s data, but is joined by the Nimnicht and Tucson 
programs in the second year's dat^... These findings appear to agree with the ob- 
jectives of the programs. The teacher "ciirection present in a teacher operated 



learning program sets off BcX^ssrooms. In contrast, EDC, Nimnicht, and Tucson 
classrc'^ms appe"ar there as ones ni which the teacher does not take a central, role 
in ''teaching'' children, but encourages pupil independence in thfe learning process 
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Table D-IO 

Multiple Range Test - Teacher Practices Observation Record 
Factor 5 - Intrinsic Motivation in a Task Setting 



1969 



1970 



Sponsor 


Mean NSR* <7 S.D. 


N 


Sponsor 


Mean NSR* S.D. 


N 


EDC 


52.18 


3.93 


8 


BE ■ 


53.35 


6-. 51 


8 


Bank St. 


51.81 




3.20 


8 


Bank St . 


52.70 


5.76 


8 


BB 


50.66 




< 4.90 


8 


' Gotkin 


52.70 


■ 5,24 


8 


Gotkin 


■ 50.58 




3.30 


8- 


Nimnicht 


50.90 




4.90 


8 


PE 


50.58 




2.14 


8 


Tucson 


49.88 . 




8 .17 


8 . 


Nimnicht 


49.91 




2.52 


8 


EDC ' 


49.70 




7.33 


8 ' 


Comp. 


48.45 


2.64 


14 


PE 


49.65 




4.35 


8 


Tucson 


47.06 


3.84 


8 


Comp . 


46.57 


4.53 


14 



2.24 p< .05 



1.54 N.S. 



Nonsignff leant ranges. 



Multiple Range Test 
Factor 6 



Table D-11 
Teacher Practices^Observation Record 
positively Fpcused Teaching 



1969 



1970 



Sponsor 


Mean 


NSR* 




S.D. 


N 


Sponsor 


Mean NSR* 


S.D. 


- IN 


BE 


60.88 










5.22 


- 8 


BE 


60.99 






2.56 


8 


Comp. 


52.12 










3.97 


14 


Gotkin 


52':'71 






4,-q3 


8 


PE 


50.93 










-2.46 


8 


Comp . 


50.97 






4.92 


14 


Bank St. 


49.08 










3.22 


8 


Bank St. 


50.54 






5.27 


8 


Gotkin 


48.57 










/2.46 


8 


PE- 


49.59 






4.82 


8 


Nimnicht 


47.58 










' 3.80 


8 ■ 


Tucson 


45.78 ■ 






3.12 


8 


Tucson 


46;71 










3.42 


8 


Nimnicht 


45.39 






5.21 


8 


-EDC 


42.53 








/ 


3.29 


8 


EDC 


44.31 






4.27 


8- 


. f = 


17;69 


P<. 


01 






F = 


11.74 p 


<.01 





Nonsignificant ranges. 
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Florida .Affective Categories System ,(1969) 

Factor 1 - Free Choice vs Structured Learning in Groups - The finding 
that EDC classrooms stand high in freedom of choice for pupils seems closely, 
aligned with program rationale, as does the standing of the BE program at the 

I a 

low end of the factor (Table D-12). The standing of Comparison classrooms 
toward "the lower end of the*, factor agrees with the common conception of class- 
rooms in general. However, the nature of the structuring done by the Compari- 
son teacher is quite different from that in Bi: classrooms; subjectively this is 
true, and other factors support and clarify this. 

Factor 2 - Intermittent Work Vs Group Singing and Games - The multiple 
range test (Table D-12) showed two homogeneous groups, indicating that the Nim- 
nicht program differs from the others at the J|igh end, perhaps reflecting the 
transition, of activities as pupils move from one to another of the various 
learning activities. Comparison classrooms are set. off at the lower end of the 
factor, perhaps reflecting a larger proportion of activities of the total class- 
The factor does not seem particularly clear, and has one of the lowest F»s of 
the FLAC factors. 

Factor. 5 - Wai^m Emotional Climate - The data of Table D-13 show two 
homogeneous subsets which indicate that Comparison classrooms differ from Nim- 
nicht classrooms which stand highest on the factor, but program classrooms do 
not differ one from another. Again, the overall F was not significant. This 
is an objective which all programs value. 

Factor 4 - Teacher Negative Affect vs Pupil Work and Socialization with 
^^"Its - The data of table D-13 show. two homogeneous subsets, indicating that 
the Tucson, BE, and EDC programs show less teacher negative affect antVor :,iorc 
pupil work and socialization than do Comparison classrooms. The avoidance of 
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Factor 1 



Table .D-12 

Multiple Range Test - Florida Affective Categories - 1969 

Free Choice vs Structured Factor 2 - Intermittent Work vs Group Singing 
Learning in Groups • or Games 



Sponsor 



Mean NSR* 



S.D. 



N Sponsor 



EDC - 


/57.61. 


Nimnicht 


55.76 


PE 


53.11 


Bank St. 


52.74 


Gotkin 


52.70 


Tucs on 


51.63 


Coihp. 


47.36 


BE 


45.51 


F 


= 7.60** 



6.47 


8 


4:25 




1.83 


5.76 


8 


2.39 


8 


2.72 


8 


5.09 


14 


3.38 


8 



Nimnicht 
Bank St. 
Tucson ' 
PE 
EDC 
BE 

notkin 
Comp. 



Mean 



53.^ 
50.54 
50.31 
50.25 
49.81 
49.28 
47.19 
46.79 

1.21 



NSR* 



S.D. 



■N 



5.31 


8 


3.0.3 


• 8 


5.81 


8 


6.67 


8 


6.17 


8 


6.84 


8 


3.56 


8 / 


8.06 


14 



Table D-13 



Multiple Range Tesitj- Florida Affective Categories 



1969 



Factor 3 - Warm Emotional^ Climate 



Factor 4 - Teacher Negative Affect vs Pupil 

""Work and Socialization wi^^h Adults 



Sponsor 


Mean NSR*" S.D. 


N 


Sponsor 


Mean 


NSR* S.D. 


N 


Nimnicht 


54.20 


4.65 


8 


Comp . ' 


54.11 


5.73 


14 


EDC 


53.06 




5.34 


8 


Nimnicht 


52.44 




8.03 . 


8. 


BE 


52.38 




■ 6.99 


8 


PE 


52.18 




4.32 


- 8 


Tucson 


52.11 




3.60 


8 


Gotkin 


50: 04 




3.47 ■ 


8 


PE 


51.03 




5.57 


8 


Bank St. 


49.70 




6.69 


8 ■ 


Bank St. 


50.45 




6.01 


8 


Tucson 


47.70 


4.74 


8- ■ 


Gotkin 


49.48 




3.25 


8 


EDC 


47.63 


3.29 


8 


Comp. 


46.93 


8.47 


14 


BE 


47.10 


" 6.45 ■ 


8 


F = 


1.54 






F = 


2.13 . 
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♦ 

correction or criticism of pupils in the Tucson program is an important aspect 
of program rationale; and the BE program stresses reinforcement of desired be- . 
haviors so that criticism of pupils is relatively infrequent, A supportive 
climate for pupils is also an important aspect of the EDC program. 

Factor 5 - Pupil Free to Withdraw, Seek Reassurance, Pretend, or Express 
Negative Affect > The data of Table D-14 show that the EDC program is widely 
separated. from other programs and Comparison classrooms. The data illustrate 
the freedom and autonomy of the pupils in 'the EDC program. 

Factor 6 - Teacher Neutral Control vs Teacher Support in Task Settings - 
The results of the multiple range test show three homogetieous groupings, and 
the overall F is significant (see Table D-14). At first it seems paradoxical 
to find the 'EDC program, in which there is a great deal of freedom for pupils, 
at the top of this factor, and the BE program, in which there is little autonomy 
for pupils, at the bottom of the factor. The issue seems to be the kind of 
freedom. As indicated in the body of the report. Factor I represents a differ^^^ 
ent dimension, interpreted as a lack of structure in which-, in extreme cases, 
the teacher apparently feels occasional need to intervene firmly (reflected in 
this factor). The structure of the BE program apparently minimizes the need 
for control as this factor identifies it. 
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Factor 5 



Table D-14 

Multiple Range Test - Florida Affective Categories - 1969 

Pupil Free to Withdraw Seek Factor 6 - teacher Neutral Control vs Teacher 

_Reass.urarice.,...Ere.tend ,qx Support -in- Task -Settings • ■ 

Express Negative Affect 



^Sponsor Mean NSR* S.D. N Sponsor 



Mean 



NSR* 



S.D. 



EDC 


58.26 


4.77 


8 


EDC 


55.21 


Bank St. 


'52.88 


7.53 


8 


Gotkin 


53.45 


PE 


52.21 


4.51 


8 


Comp. 


52.13 


Nimnicht 


52.13 


3.95 


8 


Tucson 


49.98 


Gotkin 


51 .48 


3.09 


8 


Bank St. 


49.80 


Tucson 


50.63 


4.02 


8 


PE 


48.83 


Comp. 


50.21 


5.60 


14 . 


Nimnicht 


46.98 


BE 


48.53 


4.78 


8 


BE 


46.85 


F 


= 2.72* 






F 


= 2.37* 



3 


26 


8 


6 


34 


8 


6 


37 


14 


3 


95 


8 


4. 


26 


8 


6 


95 


8 


5.. 


00 


8 


6. 


62 


. 8 
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N . / ■ 

Florida Climate and Control System (1970) ^ 

/ 

Factor 1 - Teacher Negative Control - l1iis factor separates programs into 



two groups as shown in Table D-15. The"Nimnicht and Tucson programs are separated 
from other programs at the lower end of the scale, and the Gotkin and Bank Street 
programs are separated off at the upper end. It is the subjective impression of* 
observers that the occurrence of this sort of classroom in the latter two programs 
appeared- primarily in one sthool for each\rogram -- schools whicli\wer.e sharply 
different the third year of the program. In\^ sense, it seems unfortunate to. 
report these data in relation to' p^rograms in th^ they appear to be largely school 
effect. Both were schools, undergoing change, and this stress was apparently re- 
flected in classrooms. In addition, the Gotkin program was the only one for which 
the entire sample was from large cities, where stresses more often occurj. 

Factor 2 - Pupil Freedom vs Teacher Structured Activity - The pattern of 
separations for this factor (Table d'-15) is quite similar to that of FLAC Factor 1 
for the 1969 data. The Nimnicht and' EDC programs are set off at, the top of the. 
factor, with BE set off at the lower end of the factor, and with the other pro- 
grams broken up into overlapping ranges. Again, the self-directed activity of 
pupils specified in the rationales of the EDC and Nimnicht programs is shown, 
and programmed learning directed by the teacher appears for the BE program. 

. Factor 3 - Warm Climate - Programs are discriminated statistically sig^r : 
nificantly on the factor, with three groups being identified as homogeneous. 
(See Table D-16). Depending on the range examined, the BE program or the BE 
program plus the Nimnicht program are set o'ff at the upper end of the distribu- 
tion, and the Comparison, Gotkin, and PE programs are set off at the lower "end. 

Factor 4 - Pupil Negative Behayior - The two "subgroups appear to b-e 
created by the Gotkin program being set apart at the high end. of the scale. 
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Table" D-15 

Multiple Range Test - Florida Climate and Control System - 1970 

Fjictor 1 - Teacher Negative Control Factor 2 - Pupil Freedom vs Teacher Struc- 
! ' tured Activity 



Sppnsor 


Mean NSR* S.D. 


N 


Sponsor 


Mean 


NSR* 


: ^T- 

S.D, 


N. 


Gotkin 


55.09 


7.53 


8 


Nimnicht 


57.60- 




3.2'3 


8 


Bartk St. 


54.51 


8.07 / 


8 


EDC 


57.13 




3.24 


8 


Comp . 


,51.95 


6.69 


14 • 


Tucson 


50.85 




1.39 


8 


PE 


'so. .^5 




4.22 


8 


Bank St." 


49.85 




3.93 


8 


BE 


49.57 




4.81 


8 


Gotkin 


48.81 




4.16 


8 


EDC 


4 8.38 




4.04 


8 


PE 


4 7.. 31 






5.32 


8 


Nimhicht 


45.92 


5.48 


.8 


Comp . 


46.65 




4.06 


14 . 


Tu_j:son 


45.10 


4.67 


8 


BE ■ 


44.31 




■2.03 


8 


F 


- 3.10** 






F 


= 14.50** 









Table D-16 

>^Iultiple Range Test - Florida Climate and Control System - 19 70 
factor Warm Climate Factox 4 - Pupil Negative Behavior 



Sponsor 



Mean NSR* 



S.D. 



N- Sponsor 



Mean 



NSR* 



S.D. 



BE 




/ 53.51 




4.69 ' 


8 


Gotkin 


56 


,59 


t/ 53.95 




■ 5.03 


8 


Nimnicht 


51 


.84 


51.44 






6.12 


8 


Bank St. 


51 


.18 


{ 51.28 






4.96., 


8 


PE 


49 


.89 


49.30 






8 


EDC 


49 


.79 


4 7.. 58 




5.91 ■ 


14 


Comp. 


49 


.07 


47.11 




4.90' 


8 


Tucson 


48 


.01 


45.91 




2.61 


8 


BE 


47 


.69 



F = 3.43" 



F = 2.27* 



5.19 


8 


£-.30 


8 


7.40 


8 


3.24 - 


\ 8 


4.59 


^■ 


6.17 


1.4 


4.75 


8 


4.80 


8 
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(See Table U-16). It seems prbbablfe that the position of this program again 
reflects the one school, cited earlier, in which considerable tension existed." 

Factor 5 - Structur ed Teacher Behavior with Praise - The program which • 
stands highest on this factor is the BE program (Table D-17). In a sense the 
factor seems to represent two aspects of BE rationale, in which the programmed 
learning materials. structure the behavior'of the teacher, and the teacher moti- 
vates thepupils by the use of praise. Another of the ranges separates off the 
Gotkin program at the upper end, following the BE program, presumably because 
of the extent to which the Gotkin materials structure tlje behavior of teachers 
in his classrooms. 

- Factor 6 - Pupil Conforming Behavior - There are 
tween protrams, and the F suggests that variability within the programs is 
larger than differences between programs (Table D-17). 

ft 

Factor 7 - Effective Personal Communication - the factor creates three 
subgroups, and discriminates programs significantly (Table D-18). ' In one 
separation the BE program is placed alone at the top; in another the BE and 
Nimnicht programs are set pff together at the top of the. range, The Gotkin 
program is separated at. the lower end, perhaps as a consequence of a film that 
was circulating through classrooms during the days in which observation was 
being conducted in one of the two cities from which the jJotkin data came. With 
samples as small as these, such incidental occurrences can have considerable 
effect on the placement of a group. 



no .discriminations be- 
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Table 0-17 

Multiple Range Test - Florida Climate and Control System - 19 70 

Factor S - Structured Teacher Behavior .Factor 6 - Pupil Conforming Behavior 
with Praise 



Sppnso: 



Mean NSR* 



S.O. N Sponsor' Mean 



NSR* 



/S.D. 



N 



BE 

Gotkin 

Tucson 

Comp. 

Nimnicht 

Bank St. 

EDC 

PE 



60.60 
51 .53 
50.05 
49.35 
49.08 
48.33 
46.85 
46.60 

12.83** 



3.79 


8 


BE 


51.67 


5.31, 


8 


3.45 


8 . 


Bank St. 


51.38 


4 . 73; 


■ 8 


2.67 


8 


EDC 


51.29 


4 .73 ' 


8 


2.84 


14 ■ 


Gotkin 


49.98 


4.61 


8 


2.78 


8 


Comp. 


49.83 


6.17 


14 


3.54 


8 


PE 


49.65. ^* ' 


'5.06 


8 


3. .28 


8 


! Tucson 


49.33 


7.90 


8 


5.58 


8 


V Nimnicht 


48.02 


3.05 


8 






F 


= .42 N.S. 







Table D-18 

Multiple Range Test - Florida Climate and Control System - 1970 
Factor 7 - Effective, Personal Communication 



Sponsor 


M6an 


NSR* 


S.D. 


N 


BE 


58.13 






7.11 


8 


Nimnicht 


54.10 






4.19 


8 


PE 


49.48 






2.50 


8 


Tucson 


49.15 






8.32 


8 


Bank St. 


4 8.93 






5.55 


8 


Comp. 


48.60 






5, 74 


14 


EDC 


47.73 






5.30 


8 


Gotkin 


45.83 






4.62 


8 



F = 3.94** 
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Reciprocal Category System ^ 

Factor 1 - Drill with Teacher Acceptance and Pupil Initiation vs Teacher * 
and Pupil' Initiation - The BE program is separated from 'the others both years 
(Table D-19). Tliis is not surprising since BE teachers spend much of their time 
interacting with subgroups of pupils working on programmed learning materials, 
and one of their objectives is to foster a high rate of pupil response. The 
. pattern is not the usual "drill" in that the teachers do talk at greater length 
than would be true of a rapid-fire drill session^ they accept answers, and 
praise pupils at length. 

Factor 2 - Varied Pupil Directed Interaction - The factor discriminates 
significantly between programs both years, but the order shifts. (See Table 
D-20). The EDC program stands at or near the upper end of the scale both years, 
the Nimnicht program is se.t off at the upper end the second year, and 'BE is ' 
,set off at the lower end of the scale the second year. The other programs are 
not separated from each other. The high standings of the CDC and Nimnicht pro.-' 
grams seem reasonable in that in both pupils are freer to interact with each 
other in various ways. Correspondingly, the programmed learning context in 
which much of the interaction of teacher and pupils occur^ in the BE program 
places the pupil in the position of responding to the teacher, rather than 
directing the interaction. 

Factor 3 - Warm, Nonevaluative Teaching vs Teacher Criticism - Although 
the F is not significant either year, the multiple range tes.t separates programs, 
into two groups the second year the Tucson program is separated, from the 
rest of the group at the upper end, and the Fank Street and Comparison groups 
are separated off at the lower end (Table D-2I). Tlie* high standing of the Tuc- 
son program appears to relate to its commitment to a nonevaluative climate., 

163 . 
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Table D-19 1 


* 



Multiple Range Test - Reciprocal Category System 

Factor 1 - Drill with Teacher Acceptance and Pupil Initiation vs teacher and^ 

Pupil Initiatipn 



1969 



• 1970 



Sponsor 


Mean 




NSR* 


S,D. 


N 


Sponsor 


Mean 


NSR* S.D. 

I 


N 


BE 


56.31 








5.25 


8 




59.97 




3.41 


8 


pn 


52.37 








2.66 


8 


Gotkin 


51.45 


/ 


3.73 


8 


Go,tkin 


49.97 








3.74 


8 


PE • 


51.11 




5.96 


3 


Baiik St. 


49.76 








3.38 


8 


Comp . 


49.94 




6.43 


13 


Cbmp. 


48.95 








4.07 


14 


■ Bank St. 


48.45 


1 ^ 


4.49 


. 6 ' 


Tucson 


48.49 








3.L7. • 


8 


EDC 


46.17 




6.45 


6 


EDC 


48.24 








1 .3?^^ 


8 


Tucson 


■46.10 




6.85 


8 .. 


Nimnicht 


46.13 








5.60 


8 


Nimnicht 


44.84 




1 7.00 


8 


F = 


5.12 




.01 






F 


= 5 .39 


p<. .01 





Table 0-20 

Multiple Range Test - KQciprocal Category System 
Factor 2 - Varied Pupil Directed Interaction 



Sponsor 



Mean 



1969 



NSR-* 



S.D. 



Sponsor 



Mean 



1970 



NSR'" 



S.D. 



noc 


55.26 


3 


..S8 


8 , 


Nimnicht 


57 


.16 




6.52 


8 


.Gotkin 


52.62 




5 


.86 


- 8 


EDC 


53 


.23 






3.85 


6 


BE , 


50.39 




3 


.69 - 


8 


Tucson 


52 


.48 • 






6.00 


8 


Nimnicht 


49.67 


4 


.43 


8 


Gotk-in 


5-1- 


.60 






3 . 5.3 


8 


' PE 


48.89 


3 


.18 


. 8 


Comp. 


48 


.31 




7.00 




Comp. 


48.76 


4 


.66 


14 


,PE ■' 


47 


.7-5 




5.68 


■ i 


Bank" St. 


48.12 


4 


.27 


8 


Bank St. 


47 


.10 




4.17 ■ 


6 


Tuc§on 


47.43 


6 


.50 


8 


BE 


43 


.87 




6.92 ' 


8 


F = 


2.58 p< 


.05 






F 


= 4.( 


56 • p 


< 


01 ^ - - 
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• ^ Table D-21 \ 

Multiple Range Test_-; Reciprocal^Categprylsystem 
Factor 3 - Warm, Nonevaluative Teaching vs Teacher' Correction 

• \ 



Sponsor 



Mean 



1 969 



NSR" 



S.D. N Sponsor 



Mean 



NSR" 



1970 



Tucson 


55 


.69 ■ 


' 7.80 


8 


' Tucson 


55 


.40 


BE 

.Bank St/ 


54 


47 


5.26 


8 


1 BE 


52 


:98 


49 


28 


> 6.70 


8 


i EDC 


51 


.25 


EDO 


49 


1.6 


9.81 


8 


1 Nimnicht 


50 


.50' 


.Comp. ' 


48- 


77 


10.12, 


14 


' PE 


4^ 


73 


PE 


48 


09 


5,. 65 


8 


Gotkin 


48 


73 


Nimnicht^^ 


46 


25 


' .. Il'i48 


8 


Comp. 


47 


26. - 


Gotkin 


46 


13 


5.*25 


8 


Bank St.i- 


45 


69 



F = 1.45 N.S. 



F = 2.1'5 N.S. 



S.D. 



6.41 . 


8 


3.54 


• . 8 


6.25 


.6 


6.82 


8 


7.62 


8 


6.45 


8 


5.89 


13 


3.91 


6 



Table.D-22 \ 
: - Reciprocal 

Factor 4 - Teacher Amplification in E xtende d Talk 



Multiple Range- Test - Recijjrocal Category Sys'tem 



Sponsor 



1969 



1970- 



Mean 



NSW 



S.D. 



N Sponsor 



Mean 



NSR^ 



S.D. 



Gotkin 


51.80 


3 


.34 


8' 


PE 


52.15 


6.30 


8 


PE " • 


50.85- ' 


' 1 


.69 


8 


Comp. 


51.70 


5.23 


•"13 


Tucson 


50.42 


3 


.46^ . 


8 


Tucson 


51.60- 


6": 10 


•8 


Coinp . 


49.94 


3 


.03. 


14- 


BE , • 


50.44 


3.78 J 


8 


Bank St. 


49 .-32 


2 


.53 


8 


Gotkin 


49.83 w- 


5 . 33 


8. 


BE ' . 


49-.22" 


5 


82 


8 


Bank, St_, 


49.28 


5.86 - 


6 


Nimnicht 


49.14 


3 


87 


■ 8 


EDC 


• 48.08 


6.95 


6 


EDC 


48.62 


3 


16 




Nifnnicht^ 


. 46.31 

J 


4.94' 


. 8 


F - 


0.73 N.S. 








* F 


= 1.07 N.S.. 

T 


\ 


» 
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, The low standing of the Bank Street prograrj the second year probably relates to. 

the situation of one of its schools, as cited in the body of the report. 

^ Factor 4 - Teacher Amplification in\ Extended Talk • The factor does not 

^ ^ 1 / 

discriminate programs, and the F suggests that vari^ility within programs and '* 

• « 

variability between programs are essentially equal (See Table D-22). 

Factor 5 - Pupil T^lk - The factor does'^not discriminate between programs 

■ ' ^ ' \ • 

either year, with the F suggesting that variability withiii programs is as largj 

6*r 'larger than between programs. (See Table D-ZSn. /• - 

- Factor 6 - Teacher Initiation with Pupil Interruption vs Teacher Ques- 
tion - Programs are discriminated significantly bc>th years, with two groups <the 

BE program is separated p-^ff 
at the lower end both years ;^ the Tucson program Was set off at the upper end 
the second year. The rationale of the BE progr^tn limits extended teacher ini- 
tiation in favor of soliciting pupil responses, 

Factor 7 - Teacher Direction ysyfiapil /nitiatio n - llie factor did not 
discriminate significantly the first year but/ discriminates highly significantly 
between programs^the second year (Table D-2/) . Although four ranges areUderrti- 
fied, the pps between means suggest th/ee^ groupings : BE^ Co/fiparison and Gotkin 



first year and three the second (fable^D-24) . Th 



at the upper end; PE, Bank, Street and Tucfson in, the r*Ldrange; a'l^^ EDC and 
Nimnicht at the lower end. The extrem^evpositions appear to agree with program 
rationale. Teacher direction of learning is a central aspect of the programming 
of ^earning (BE), and minimal direction of pupils seems equally central to the 
Nimnicht classrooms in which pupils are expected to learn from self-teaching 
equipment and EDC classrooms in whicli the child is exposed to rich materials 
and encouraged to follow his interests to a large degree. 
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Table D-23 

Multiple Range Test - Reciprocal Category System 
Factor 5 - Pupil Talk 



1969 



1970 



Sponsor 


Mean NSR* S.D. 


N 


Sponsor 


Mean NSR* S.D. 


N 


EDC 


, 52.04 


6.01, 


8 


Nimnicht 


\53.43 


5.35 


8 


BE 


51.78 


9.27 


8 


BE 


52.89 


7.51 


8 


Tucson 


51.75 


8.40 


8 


— — Tucson 


. 5^2.37 


7.08 


8 . 


Bank St. 


49.84' 


7^ 


8 


PE . 


50.45 


7,.iL9 


8 


Coinp. 


49.32 




14 


EDC 


49.26 


" 7.80 


. 6 


PE 


49.25 


6.2o\ 


8 


Bank St. 


48.64 


10.41 


b 


Gotkin.- ' 


- . 49.18 


12,62 ) 


8 


Gpmp. 


46.96 


8.51 


13 


Nimnicht 


' 47.50 


5.80 / 


8 


Gotkin 


46.13- 


3.70 


8 


F 


= 0.33- N.S. 


A / 




F 


= f.1.8 N.S, 







Table D-.24 ^ 

Multiple Range Test - Reciprocal Category System 
Factor 6 - Teacher Initiation with Pupil Interruption vs Teacher Question 



Sponsor 



1969 



1970 



Mean 



NSR^ 



S.D. N SponXor 



Mean 



NSR* 



•S.D. 



Nimrricht 
Comp . 
Tucson 
PE 

Bank St. 
EDC 

Gotkin 
BE 



54.55 
51.69 
50!93 
49.82 
49.71 
49.40 
49.20 
39.73 



7. or 

4.62 
11.75 
6.33 
5.57 
7.47 
6.30 
4.57 



F = 3.22 p < .01 



8 
14 
8 
8 
8 
8 
8 
8 



Tucson 
Nimnicht 
Comp . 
EDC \ 
Bank St . 
PE 

Gotl<in • 
BE 



55.90 
53.24 
52.51 
51.52 
49.43 
48.25 
\ 47.25 

\ 39.85 

\ 

= '5.10 • p < .01 



5.27 


8 


4.73. 


8# 


9.43 


13 


4.72 


6 


4.92 


6 ' 


4.67 


. 8 


5.30 


. 8 


5.11 


8 
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Table- D-25' - 
Multiple Range Test - Reciprocal' Category Sw/tem 
Factor 7 - Teacher Direction vs Pupil Initiation 



1969 



Sponsor 


MfiSn— NSR* S.D. . 


N 


Sponsor 


Gotkin 


.51.96 ■ 


3.70 


8- 


be' / 


PE 


51.39 


4.13 


8 


Comp . n 


Comp. 


51.31 


5.68 


1 14 


Gotkin^ ■ 


Bank St. 


49.97 


4.42 


1 8 


PE / 


BE 


49.92 ■ 


3.76 


8 


Bank/ St . 


Tucson 


49.34 ^ 


5.75 


8 


Tucson 


Nimnicht 


47.65 


4.89 


8 


EDC 


EDC 


46.62 


4.75 


8 


Nimnicht 



1970 



Mean 



NSR^ 



S.D. 



F = 1.30 N.S. 




Table D-2,6 

Multiple Range Test - Reciprocal Category System 
Factor 8 - Supportive Pupil Talk 



/ 

Sponsor 



1969 



Mean 



NSR* 



S.D. 



Sponsor 



MMean 



1970 



NSR* 



EDC 


54.21 


7. .85 


.8 


Nimr>4ch<' 


55.46 


Gotkin 


53.38 ' 


8.82 


8 


Got/kin 


54.59 


PE. 


51.67 


7.63 


8 


Tuclpon 


51.04 


Bank St. 


, 50.92 


7.29 


8 


EDC 


50.89 


BE 


49.92 


5.54 


8 


PE 


50.25 ■ 


Tucson 


48.92 


5.42 


8 


BE 


48.92 


Comp . 


47.62 


-1.58 


14 


Comp . 


48.36 


Nimnicht 


47.50 \ 


1.41 


8 


Bank St. 


46.50 


- .F = 


,l-.58 N.S. \ 






F = 


2.05 N.S 



S.D. 



|8.28 
!7 . 60 
f .61 
3.70 
7.68 
6.57 
41. 02 
1122 



8 
8 
8 
6 
8 
8 
13 
6 
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Factor 8 - Supportive Pupil Talk - As mentioned in the body of theSreport 
this factor appears to' be a reflection of the achievement of program objecti^. 
directed at fostering supportive social behavior among pupils. Hie discrimina- 
tion Detween programs did not result in a significant F either year (Table D-26) 
The multiple range test separated off the EDC program^at the upper end of the , 
scale the firs^t year, and the Gotkin and Nimnicht programs the second year. 

4k 

Bank Street and Comparison classrooms were separated off at the lower end of the 
scale the second yearv^ ' . " / 

this measure, made up of pupil talk, may be subject to the bias cited in 
the Procedure section tliat some programs more than others organize pupil acti- 
vity in such a way that their talk is audible. Pupils are likely to be more 
audible in BE classrooms, for instance, and less so in EDC classrooms. 
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Cognitive Taxonomy 

Factor 1 - Highly l-ocused Learning Tasks ^ The multiple range ^ests for 
each of the two years place the Becker-Engelmann program at the top of| the scale 

(Table D-27) . There is no consistency in the programs separated at thh lower 

i 

end of the factors the two years* The position of the BE program seem^ in line 
with its orientation toward fostering the development of skills* OtKerj pro- 
-ams shift extensively in their reiative rank order in the remainder* of the 
jrange so that probably only the BE position can be taken as meaningful. 

Factor 2 - Narrow vs Broad Ansvyer - Although the positive pole is labeled 
"narrow'* it represents a high cognitive level; the negative pole appears to be 
less subject-matter oriented, and at a lower cognitive level, but no one answer 
woul4 be expected. Each year, programs were separated into two groups, but ' 
the F's were not significant either year. (See Table l)-28) . The first year,. ' 
the BE program was separated off at the upper end of the scale, the second year 
it was a part of the top group along with Comparison classrooms and the NimnicKt 
program. Both years, the EDC program was separated off at the lower end of the 
scale. Iliese separations seemed to fit satisfactorily with the concern for 
fostering subject matter skillis, which is typical of BE classrooms, and which 
has been recognized as a primalry concern of Comparison classrooms. NLmnicht 
classrooms are also high on this factor and appear to support the development 
of subject matter skills, although they do so in a different way than the other 
two programs. 'ITie EDC program, in contrast, does not, make that sort of skill - 
development a central issue in the early years. 

Factor 3 - Ntoderately Focused Learning Tasks - llie factor discriminates 
significantly between programs the second year, and approaches, significance the 
first year (Table D-29) * IVo groups are set off each year, with BE at the 
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^ ' Table D-27 

Multiple Range Test - Cognitive Taxonomy 
^ Factor 1 - Highly Focused Learning Tasks 



Sponsor 


1969 






1970 




Mean ^ NSR* S.D. 


N , Sponsor 


Mean 


NSR* S.D. 


N 



BE 


54.78 


5.30 


8 


BE 


57.06 


1 5.37 


8 


PE 


53.23 




6.85 


8 


Gotkin 


52.14 


4.13 


8 


Bank St. 


50.96 




7.60 


8 


Nimniclit 


51 .80 




5.26 


8 


E.DC 


49 ."94 




4.93 


8 


Comp . 


48.99 




6.10 


13 


^Tucson 


48.73 




- 7.17 


8 


Bank St. 


48.95 




4.92 


6 


Gotkin 


48.51 




3.77 


8 


PE 


48. 38 




3.99 


8 


Nimnicht 


48.19 




5.14 


8 


EDC 


46.77 




2.82 


- 6 


Comp. 


47.33 


7.02 


14 


Tucson 


46.30 




4.55 


8 


/ F 


= 1.60 






F = 


3.98** 







Table D-28 
Multiple Range Test - Cognitive Taxonomy 
Factor 2 - Broad vs Narrow Answer 



1969 



1970 



Sponsor 


Mean NSR 


* S.D. 


N 


Sponsor 


Mean 


NSR* S.D. 


N 


BE 


53.58 , 


4.79 


8 


Nimnicht 


51 .99 




3.95 


8 ' 


— ^ Bank St. 


52.78 




5.79 


8 


Comp . 


51.31 




3.26 ■ 


13 


PE 


51.00 




5.76 


8 


BE 


50.41 




3.27 


8 


Comp. 


50.66 




5.52 


14 


Bank St. 


50.40 






3.04 


6 


Tucson 


50.18 




4 .81 


8 


Tucs on 


r 49.93 






2.45 


8 - 


Gotkin 


48.29 




3.34- 


8 


Gotkin 


49 . 54 






2.55 


•■ 8 


Nimnicht 


47.64 




2.89 


8 


PE 


48.28 






4.24 


8 


EDC 


47.14 


7.40 


8 


EDC 


46.32 




2.4 3 


6 


F 


= 1.61 






F 


= 2,21* 
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Table- 0-29 

Multiple Range Test - Cognitive Taxonomy 
Factor 3 - Moderately Focused Learning Tasks 



Sponsor 


1969 






1970 ' 




Mean- NSR* S.D. N 


Sponsor 


Mean 


NSR* S.D. 


N" 















BE 


5.3 


.91 


5 


98 


8 


BH 


54 


.20 


3 


.04 


8 


' PG 


53 


.28 


5 


.69 


8 


Gotkin 


52 


.31 


3 


78 


8 


GDC 


51 


.58 




6 


.79 


8 


Nimnicht 


51 


.23 




2 


34 


•8 


^ Nimnicht 


50 


.39 




5 


.30 


8 


Bank St.. 


50 


.70 




5 


20 


6 


Bank 'St. 


50 


.38 




5 


.74 


8 


PG 


49 


.94 




4 


61' 


8 


Gotkin 


48 


.05 




6 


26 


. 8 


Tucs on 


47 


.98 


3 


70 


8 


Tucson— 
Comp. ^ 


47 


.33 




4 


44 


8 


Comp. 


M7 


.72 




4 


67 •■ 


13 


46 


.04 


6 


66 


■ 14 


GDC 


47 


.55 


2. 


08 


6 


F = 


2. 


13 








F 


= 3. 


15** . 









Table D-30 



Multiple Range Test - Cognitive Taxonomy 
Factor 4 -' Phonics 



L969 



Sponsor Mean NSRf 



S.D. 



Sponsor Mean 



1970 



iNSR^ 



S.D. 



BE 
PG 

Tucson. 
Nimnicht 
UDC V 
Comp ^■ 



55.60 
52.13 
49.96 
49.36 
48.99 
48.89 



Bank St. ,48.55 
^47.26 



Gotkin 



F = 2.70* 



4.07 
3.44 
4.16 
5.44 
6.00 
4 .36 
4.84 
3.76 



8 
8 
8 
8 
8 
14 
-8 
8 



BE 

Bank St. 
Tucs c n 
Comp. 
Gotkijn 
PG 
GDC 
Nimnilcht 



55. 13 
53.07 
50.11 
49.79 
49.10 
48.76 
47.90 
47.01 

2.21* 



6.78' . 


8 


5.53 


6 


4-.81 


■8 


4.92 


13 


5.30 


■ 8 


4^92 


8 


2.24 


6 


3.69 


8 
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upper end both years, accompanied by PE the first year and Gotkin the second 
year. Comparison classrooms are set off at the lower end both years, joined by, 
fiDC and Tucson the secqnd year. Ihe placement of the , BE program appears to 
reflect its em.phasis on teaching skills, and related broader generalizations 
such as classification. The placement of EDC classrooms also seems reasonable 
in relation to their lower emphasis on teaching skills.t^ The position of Com- 
pfarison classrooms seems surprising in relation to the expectation that teaching, 
of skills would be emphasized there;^ 
I It is probably relevant to mention again the caution cited in the Pro- 

cedure section, that some programs are likely to be more completely re presen ted 
on tape than others -- probably BE would be better represented and EDC less well 
represented in terms of the proportiqjijiof pupil activity which is oral, and the 
proportion of what is oral that is audible. To some degree, the placement of 
programs on the data of the Cognitive Taxonomy_is probably biased in this respect 

Factor 4 - Phonics - Programs were discriminated significantly, with two. 
groups created both years. The BE program was set off at the upper end of the 
dimension Both years (Table D-3Q), and again, the BE em^phasis on skill teaching ^' 
seems relevant. ^ ' ^ , - , . 

s Factor 5 - Information Giving and Receiving - Programs were discriminated 

significantly the first year but not the second (Table D-31) . In the first 
year's data, the PE program is set off at the upper end of the factor, the Tuc- 
son at the lower end, joined by Bank Street and* Gotkin set off by other ranges.. 
Although Parent Education is not primarily a classroom oriented program, it has 
had a varying emphasis on a Tiagetian theory of child development. Pupils* 
establishment of an adequate base of information (as well as higher level cog- 
nitive activities) is relevant to that theoretical orientation. Perhaps the 
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■ Table D-31 
Multiple Range Test-^CD-ghitive Taxonomy 
Factor 5 - Information Giving and Receiving 



Sponsor 


1969 








1970 




Mean NSR* S.D. 


N 


Sponsor 


Mean 


NSR* S.D. 


N 



PE - 
Nimnicht 
BE 
'EDC 
Comp. 
Gotkin 
-Bank St. 
Tucson 



5-4.38 
51.70 
51 .63 
51.60 
49.29 
47.41 
47.38 
4 3.69 



F = 2.61: 



5.43 


8 


BE 


51 .81 


6.65 


8 


5.80 


8 


Comp. 


51.33 


4.16 


13 


5.65 


8' 


Gotkin ■ 


50. 18 


4 .50 


8 


6.95 


8 


EDC 


49.80 


6.63 


6 


6.30 


14 


Bank St. 


49.75 


4 .21 


6 


5.12 


8 


Nimnicht 


48.80 


5.18 


8 


6.73 


8 


Tucson 


-4-8T4-e — ^ 


5.53 


• 8 


4.78 


8 


PE 


4 8.05 


5.96 


8 



.56 N.S. 



Table .D-32 
Multiple Range Test - Cognitive 



Taxonomy 



^\Factor 6 - Complex Think^ing 



1969 



1970 



Sponsor 


Mean NSR* S.D. 


N 


Sponsor 


Mean . NSR* S.D. 


N 


BE 


53.25 


5.28 


•8 


Nimnicht 


52.56 


5.02 


8 


Bank St. 


51.25 


3.94 


8 


Gotkin 


51 .48 


6.35 


8 


Nimnicht 


50.14 


5.40 


8 


Comp. 


50.80 


4.87 


13 


PE 


49.99 


5.28 


8 


PE 


50.65 


6.21 = 


8 • 


Comp. 


49.71 


4.75 


14 


BE 


49.40 


4.14 


8 .' 


EDC 


49 . 66 


3.73 


8 


■ EDC 


49.15 


3.71 


6 


Gotkin 


49.34 


5.76 


8 


Bank St. 


48.80 


2.16 


6 


Tucson'^ 


48.86 


5.62 


8 


Tucson 


48.69 


5.63 


8 


F = 


.62 N.S. 


/ 




F = 


-.59 N.S. 
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failure of programs to separatle the second year (ajd the narroiyed range) reflects 

\— - ' ' ' 

increasing concern of all sponsors with this objective, although this interpret 

tation is speculative. ' ■ . 

Factor 6 - Complex Ihinking - This factor did not discriminate between 

programs either year, ,and the F each year suggests that variability within 

programs is as great or greater than differences! between programs (Table D-32) . 

This seems a surprising finding in the light of differences between programs 

in their emphasis on inquiry learning. It"^ seems possible that the program bias 

on audibility cited earlier may have the effect of artificially minimizing ^)ro- 

gram differences on this factor. . 



Appendix E 
Table K-1 
Reciprocal Category Measures 



Variable Description 



1 Teacher warms, informalizes the climat.e. The sum of column 1. 

2 Teacher. accepts. Tlie 5>um of column 2. 

3 Teacher amplifies. The sum of column 3. 

4 Teacher elicits. The sum of column 4. 

5 Teacher responds. The sum of column 5. 

6 Teacher initiates. The sum of column 6. * , t 
'7 Teacher direct^ 'iTie sum of column 7. . - * 

8 Teacher. corrects . The sum of column 8. 

9 Teacher cools, formalizes. Tiie sum of column 9., 

10 Pupil elicits. The sum of 14. 

11 Pupil responds. The sum of 15. 

12 Pupil initiates. The sum* of 16. * . 
.13 Pupil^ directs. The sum of 17. , ^ 

14 Pupil corrects. The sum of 18.^ ' « 

15 Confusion (does not include uncodeable tape). The sum of column* 20. 

-»^\ 

16 Teacher talk, percent.. The sum of caluiiins 1-9 divided by columns 1-0 
plus columns 11-19. . ' • 

17 Teacher acceptance-rejection, percent. Ihe sum of columns 1, 2, and 
3 divided by columns 1, 2, and* 3^'plus 8 an^ 9 . 

18 Pupil initiation. The sum of column 16 divided by total student talk* 
the sum of columns 11-19. 
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Table E-1 - Continued 



Variable ' Description *' 

19 Student response to teacher. Rows 1-9 for column 15, divided by 
total student tal^k. 

20 Pupil-pupil talk. The sum of rows 11-19 for columns 11-19 • 

21 Teacher extended indirect r' The'^'sums of the cells in rows 1, 2*, and 
3 for columns 1,^2, and 3, 

lb 

22 Teacher extended direct. The sum of the cel).s in rows, 7-9 for 
columns 7-9. 

23 ^' Teacher revised I/D. This measure involved teacher indirect response 

(rows 11-19 for columns 1-3), and teachei/direct response (rows 11- 
19 for column§, 7-9). The percentage is /made up of indirect response' 
divided by- indirect response plus direcc^response . 

24 Pupil positive participation, percent/ Positive participation divided 
by positive participation^ plus negative participation (roWs 15, 16, 
for columns ll-13/xt)ws 15; 16 for columns H-13, plus rows 15,^16 for 
columns 17-19),. ^ . " ' I 

25 Pupil revised I/Dj.. This measure includes pupil extended indirect' 
(rows 11-19 for columns 11-13) ; and pupil extended direct (rows 11- 
19 for columns 17-19); with pupil extended indirect diyided by 
pupil extended direct, plus pupil extended indirect. 

'26 Teacher narrow question. The sum of the 4-15 ceM. 

27 Teacher broad question. The sum of the 4-16 cell. 

28 Pupil broad question. The sum o£ the 14-16 cell. 

29 Pupil substantive interruption. Tlie row 6, columns 14-16 cells* 

30 Pupil direct interruption. The .row 6, colucns 17-19 cells. 

31 Total pupil interruption. Tlie total of pupil substantive interruption 
plus pupil direct interruption. 

32 Pupil question, teaclier question. Tlie 14-4 cell. 

33 Pupil question, teacher response. Tlie 14-5 cell. 



1 
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